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Abstract. We consider the problem of topological linearization of smooth 
(C°° or C") control systems, i.e. of their local equivalence to a linear con- 
trollable system via point-wise transformations on the state and the control 
(static feedback transformations) that are topological but not necessarily dif- 
ferentiable. We prove that local topological linearization implies local smooth 
linearization, at generic points. At arbitrary points, it implies local conjugation 
to a linear system via a homeomorphism that induces a smooth diffeomorphism 
on the state variables, and, except at "strongly" singular points, this homeo- 
morphism can be chosen to be a smooth mapping (the inverse map needs not 
be smooth). Deciding whether the same is true at "strongly" singular points 
is tantamount to solve an intriguing open question in differential topology. 



1. Introduction 
Throughout the paper, smooth means of class C°°. 

In the early works [12 0J [2Z] , nice necessary and sufficient conditions were ob- 
tained for a smooth control system x = f(x,u), with state x € lR n and control 
u e M m , to be locally smoothly linearizable, i.e. locally equivalent to a control- 
lable linear system by means of a diffeomorphic change of variables on the state 
and the control. The afore-mentioned conditions require certain distributions of 
vector fields to be integrable, hence locally smoothly linearizable control systems 
are highly non generic among smooth control systems. Similar results hold for real 
analytic control systems with respect to real analytic linearizability. 

Consider now the topological linearizability of a smooth control system, namely 
the property that it is locally equivalent to a controllable linear system via a home- 
omorphism on the state and the control which may not, this time, be diffcrcntiable. 
Obviously, smooth linearizability implies topological linearizability; the extend to 
which the converse holds will be the main concern of the present paper. We address 
the real analytic case in the same stroke. 

In brief, our goal is to describe the class of smooth control systems that are 
locally topologically linearizable, yet not smoothly locally linearizable. This class in 
nonempty : the smooth (even real-analytic) scalar system 

x = u 3 u e M, x e M, (1) 

gets linearized locally around (0, 0) by the homeomorphism (x, u) i— ► (x, u 3 ), whereas 
the conditions for smooth linearizability fail at this point. However, we observe on 
this example that the conjugating homeomorphism has much more regularity than 
prescribed a priori: 

1. it is a smooth (even real-analytic) local diffeomorphism around all points (x,u) 
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such that ti^O, 

2. it is triangular and induces a smooth (even real-analytic) diffeomorphism on the 
state variable (i.e. the identity map x i— > x), 

3. it is a smooth (even real-analytic) map that fails to be a diffeomorphism only 
because its inverse is not smooth. 

Theorem l5.2l of the present paper states that this example essentially depicts the 
general situation. More precisely, if a smooth control system is locally topologically 
linearizable at some point (x, u) in the state-control space, then 
V . in a neighborhood of (x,U), the system is locally smoothly linearizable around 
each point outside a closed subset of empty interior (an analytic variety of positive 
co-dimension in the analytic case), 

2'. around (x,u), there is a triangular linearizing homeomorphism that induces a 
smooth diffeomorphism on the state variable, 

3'. the above-mentioned homeomorphism is smooth (although its inverse may not), 
at least if df/du has constant rank around (5, u) or if sup^, Rank9 / / du(x , u) = m 
on every neighborhood of (x,u). 

Similar results hold for real-analytic linearization of a real-analytic system. 

A homeomorphism satisfying 2' will be called quasi-smooth (see Definitions 13.91 
15. ip . hence our main result is that local topological linearizability implies local 
quasi-smooth linearizability. A point (x, u) where the first rank condition in 3' is 
satisfied is called regular, and at such points local smooth linearizability is equivalent 
to local topological linearizability (c/. Theorem 15. 4p . A point (x,u) where none 
of the rank conditions in 3' are satisfied is called strongly singular. Whether the 
conclusion of 3' continues to hold at strongly singular points raises an intriguing 
question in differential topology, namely can one redefine the last components of 
a local homeomorphism whose first few components are smooth so as to obtain a 
new homeomorphism which is smooth? The answer seems not to be known, see the 
discussion in section |5~T1 

Motivations. They include the following. 

1. For systems without controls, i.e. ordinary differential equations, local lin- 
earization around an equilibrium has generated a sizable literature, see Section [5] 
for a small sample. It tells us that, even for a real analytic o.d.e., linearizability 
much depends on the admissible class of transformations (formal, real analytic, 
C k or topological). For instance, although analytic linearization requires subtle 
conditions relying upon a refined analysis of resonances and small divisors, the 
Grobman-Hartman theorem says nevertheless that topological linearization is al- 
ways possible at a hyperbolic equilibrium. As one might suspect (this is indeed 
shown in section 15. 4| , no naive analog to the Grobman-Hartman theorem can hold 
for control systems because they feature a family of vector fields rather than a 
single one. However, it might still be expected that relaxing the smoothness of 
the allowable transformations increases the class of linearizable control systems. It 
is in fact hardly so: we knew already from 02 [27J that C 1 linearizability of a 
smooth control system implies smooth linearizability, and we prove here that for C° 
linearizability this class does not get much bigger. In particular, there are no subtle 
questions about resonances and one may say that the most prominent feature of a 
control system is to be, or not to be linearizable, regardless of smoothness. 

2. Linearizable control systems are systems with linear dynamics, whose non- 
linear character lies in their input-to-state and state-to-output maps only. Such 
models are advocated in [13l [22] for identification (in the discrete-time case) , as 
their reduced complexity makes them more amenable to standard techniques. It is 
therefore natural to investigate this class, and topological equivalence is about the 
weakest possible from the point of view of identification. 
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3. From a control engineering point of view, it is common practice to design 
locally stabilizing feedback laws for a given system based on its linear approximation 
when the latter is controllable... and to a certain extent one believes that the 
latter and the former locally "look alike" . It is therefore legitimate to ask about 
the relationship between them. Since no discriminating topological invariants are 
known, topological conjugacy might appear as a good candidate. The present paper 
shows that the relationship is almost never that strong: topological conjugacy to 
the linear approximation is almost as rare as differential conjugacy. 

Incidentally, a system whose linear approximation is not controllable may still 
happen to be locally topologically linearizable, i.e. equivalent to a linear control- 
lable system (which is not its linear approximation). This phenomenon is clarified 
in section [5^1 

Techniques. The conditions for smooth linearizability derived in [121 [5J [S7J come 
up naturally in some sense. Indeed, to any control system, one may associate a 
sequence of distributions defined via a construction using Lie brackets of vector 
fields attached to the system; it turns out that the instance of this sequence of 
distributions for linear systems yields "constant" -hence integrable- distributions 
that span the entire state space in a finite number of steps if the system is con- 
trollable. Since Lie brackets and integrability of distributions are preserved under 
local diffeomorphisms, this translates at once into necessary conditions for smooth 
linearizability, shown in \12\ [27J to be sufficient. In contrast, homeomorphisms 
do not allow to pull back Lie brackets or tangent vector fields; hence the same 
conditions need not be necessary for topological linearization, and the proofs in the 
present paper are more intricate. Specifically, we have to rely upon the notion of 
orbits of families of smooth vector fields rather than integral manifolds. The proof 
of Theorem 15 . 21 uses classical results concerning such orbits, first established in [25] . 
that we recall and slightly expand in Appendix [51 Incidentally, the lack of a theory 
dealing with orbits of C k vector fields (A; £ IN) is the main reason why the results 
of the present paper restrict to C°° or (i.e. real analytic) control systems. 

Hopefully our method can be useful to study local topological equivalence to 
other classes of systems than linear ones; this is not investigated here. 

Organization of the paper. Section [2] recalls classical facts on local linearization of 
ordinary differential equations. Section[3]introduces conjugation for control systems 
(under a homeomorphism, a diffeomorphism, etc.) and establishes basic properties 
of conjugating maps. Section [4] reviews (topological, smooth, linear) conjugacy 
between linear control systems after [H [25] . Section [5] states the main result of 
the paper (Theorem 15. 2[) . namely that local topological linearizability implies local 
quasi-smooth linearizability for smooth control systems (smooth meaning either 
C°° or C"), and discusses the gap between smooth and quasi-smooth linearizability, 
including geometric characterizations thereof. Section[6]contains the proofs of these 
results; the proof of Theorem 15.21 given in subsection 16.21 relies upon section [31 
results from [25j stated in Appendix [Bl and technical lemmas from Appendix [XJ 

2. Local linearization for ordinary differential equations 

Consider the differential equation 

x(t) = f(x(t)), (2) 

where / e C k (U, ST) with U an open subset of M n and k E N U {oo, u), k > 1. 

It is well known (the "flow box theorem", see e.g. [2]) that, around each xo € U 
such that f(xo) ^ 0, there is a change of coordinates of class C k that conjugates ^ 
to the equation x\ = 1, x 2 = 0, . . . , x n = 0. Hence all differentiable vector fields are 
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equivalent to each other, at points where they do not vanish, via a diffeomorphism 
having the same degree of smoothness (including real analyticity) . 

At a point xq € U such that f(xo) = 0, i.e. at an equilibrium of the dynamical 
system ([2]) , its linear approximation is the system 

x{t) = Ax{t) - Ax (3) 

where A = Df(xo) is the derivative of / at xq. The equilibrium xq is said to be 
hyperbolic if the matrix A has no purely imaginary eigenvalue. 

The problem of locally linearizing (J2j is that of finding a local homeomorphism 
h : V — > W around xq mapping the trajectories of (J2J in V onto trajectories of ^ 
in W in a time-preserving manner. In other words, if 4>t denotes the flow of (J2J, 
we should have for each x £ V that 

hocj) t (x) = e At (h(x) - h(x )) + h(x ) 

provided that 4> p (x) £ V for < p < t. When this is the case we say that 
h conjugates ^ and ((3]), and we speak of topological, C fc , smooth, or analytic 
linearization depending on the regularity of h and h . 

Local linearization at an equilibrium is a very old issue. At the beginning of the 
twentieth century, H. Poincare already identified the obstructions to the existence 
of a formal change of variables h that removes all the nonlinear terms when / 
is analytic. These are the so-called resonances, see e.g. [El [2]- In fact, resonant 
monomials of order £ are obstructions to linearizing the Taylor expansion of / at 
order £ and consequently also obstructions to C £ linearization. However, although 
there exists a formal power series expansion for h when there are no resonant 
terms, the existence of a convergent power series for h (analytic linearization) is 
a delicate issue. When the eigenvalues of the Jacobian belong to the so-called 
Poincare domain, the absence of resonances indeed implies analytic linearizability 
(the Poincare theorem). If it is not the famous theorem by Siegel gives 

additional Diophantinc conditions on these eigenvalues to the same conclusion. 
These conditions are generically satisfied in the measure-theoretic sense [2j. If no 
eigenvalue of the Jacobian is purely imaginary, it turns out [20] that the absence 
of resonances is also sufficient for smooth (h, hr 1 of class C°°) but in general not 
real analytic linearization. This is still valid when / is merely of class C°°. 

In contrast, if one allows conjugation via a topological but not necessarily dif- 
ferentiable homeomorphism, the Grobman-Hartman theorem asserts that every or- 
dinary differential equation with no purely imaginary eigenvalue of the Jacobian 
(hyperbolicity) can be locally linearized around an equilibrium, that is, resonances 
are no longer an obstruction. A proof of this classical result can be found in [5]: 

Theorem 2.1 (Grobman-Hartman). Under the assumption that xq is a hyperbolic 
equilibrium point, system ^ is topologically conjugate to system ^ at xq- 

In fact, it is proved in [28] that the conjugating homeomorphism h (together 
with its inverse ft. -1 ) can be chosen Holder-continuous, and even differentiable at 
xq (but not in a neighborhood). This brings additional rigidity to the mapping h. 

The above theorem entails that the only invariant under local topological conju- 
gacy, around a hyperbolic equilibrium, is the number of eigenvalues with positive 
real part in the Jacobian matrix, counting multiplicity. Indeed, as is well-known 
(c/- [I]), the linear system x — Ax where A has no pure imaginary eigenvalue is 
topologically conjugate to x — DX, where D is diagonal with diagonal entries ±1, 
the number of +1 being the number of eigenvalues of A with positive real part. 
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3. Preliminaries on topological equivalence for control systems 

3.1. Control systems and their solutions. Consider two control systems where 
n, m, n', m! are natural integers : 

x = f(x, u) , x e M n , B6 M m , 
z = g{z,v) , ze M n ' , ve M m ' , 

or expanded in coordinates : 

X\ = fi(xi,...,X n ,Ul,...,U m ) Zi = gi(zi,...,Z n ',Vi,. 

X n — f n (^1 , • ■ ■ i X n , Ui : . . . , Urn) %7l' — Qn r (^1 i • ■ - > %n' : ^1 ) 

where x or z is called the state and u or v the control. 

Although our main results are stated (in section [5|) for infinitely differentiable 
— or real analytic — control systems, their proofs deal with non-smooth objects 
because the transformations we consider are only assumed to be continuous. This 
leads us to keep smoothness assumptions to a minimum in the present section. 
Accordingly, the maps fa : M n x M m — > M and g t : Ft 71 x M m ' — > M are assumed to 
be at least continuous; any additional regularity assumption will be stated explicitly. 
We do not restrict their domains of definition; this is no real loss of generality 
because they could anyway be extended using partitions of unity (real analyticity 
plays no role in the present section), and whenever a result is stated, the domain 
where it holds true is precisely stated and the value of / and g outside this domain 
does not matter. 

If m is zero or / does not depend on u, equation ((H) reduces to the ordinary 
differential equation © . Of course "genuine" control systems are those whose right 
hand side does depend on the control. 

Definition 3.1. By a solution of ^ that remains in an open set C M n+m , we 
mean a mapping 7 defined on a real interval J, say 

t ^ 7 ( t ) = ( 7l ( t ) ) 7E (t)) 

with 71 (t) € M n and jx(t) <E M m , such that : 

• 7 is measurable, locally bounded, and 71 is absolutely continuous, 

• whenever [Ti,T2] C I, we have : 

7i(T 2 ) - Tim) = / 2 /(71W , 7ir(t))d* • (7) 

Solutions of ([5|) that remain in Q! C M n +m are likewise defined to be mappings 
7' : I -> O' 

t ^ y(<) = (7i'W,7^W) 

having the corresponding properties with respect to g. 

If (x, u) is a point in fl, U a neighborhood of u such that {x} x U C ft, J a 
real interval, and 71 : J — > IA a measurable and locally bounded map, then, by [HI 
Ch. 2, Theorem 1.1] and the continuity of /, there exists, on a possibly smaller 
interval I C J, a solution 7 of Q that remains in fl subject to the initial condition 
7i(0) = x. This solution may not be unique without further assumptions on /, for 
instance that it is continuously differentiable, or merely locally Lipschitz in the first 
argument. 



(4) 
(5) 



(6) 



(8) 
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Remark 3.2. Observe that Definition 13.11 assigns a definite value to 7n(t) for each 
t € I. Of course, since 71 remains a solution to Q when the control 7n gets redefined 
over a set of measure 0, one could identify two control functions whose values agree 
a.e. on J, as is customary in integration theory. However, these values are in any 
case subject to the constraint that -f(t) £ CI for every t £ I, and altogether we find 
it more convenient to adopt Definition 13.11 

3.2. Feedbacks. In the terminology of control, a solution in the sense of Definition 
13.11 would be termed open loop to emphasize that the value of the control at time 
t is a function of time only, namely that 71 (t) bears no relation to the state x 
whatsoever. A central concept in control theory, though, is that of closed loop or 
feedback control, where the value of the control at time t is computed from the 
corresponding value of the state, namely is of the form a(x(t)). To make a formal 
definition of a feedback defined on an arbitrary open set, we need one more piece 
of notation : if O C M n x M m is open, we let ir n : CI — > CIm™ the natural projection 
that selects the first n components, where Or™ = TnO^O C M n . 

Definition 3.3. Given an open set ft C M n+m , a feedback on SI is a continuous 
mapping a : fln n — * such that (x,a(xj) £ CI for all x £ fijjn. A C°°(resp. 
C w ) feedback on 51 is one of class C°°(resp. C w ). 

A feedback is nothing but a mapping a such that x <— > (x, a(x)) is a continuous 
section of the natural fibration n n : CI — ► Clan. Of course, there are sets CI whose 
topology prevents the existence of any feedback. However, if there is one there are 
plenty, among which C°°feedbacks are uniformly dense. This is the content of the 
next proposition, that will be used in the proof of Theorem 15.21 To fix notations, 
let us agree throughout that the symbol || || designates the Euclidean norm on 
1R 1 irrespectively of the positive integer £, while B(x, r) stands for the open ball 
centered at x of radius r and B(x,r) for the corresponding closed ball. 

Proposition 3.4. Let CI be open in M n+m , and a : — * M m be a feedback on CI. 
To each e > 0, there is a C°° feedback (3 : — * M m such that \\a(x) — (3{x)\\ < e 

for X £ SljR" . 

Proof. Let = /Co C /Ci • • • C K-k C K-k+i ■ • • be an increasing sequence of compact 
subsets of ]Rrz , each of which contains the previous one in its interior, and whose 
union is all of f2 jj™ • For each x £ ; define an integer 

k(x) = min{/c £ N; x £ IC k } . (9) 

To each k, by the continuity of a and the compactness of ICk, there is (Xk > such 
that 

x £ IC k => { ' * C ° n j { } „ C ° ' „ (10) 

(_ • vui,U2 € Oonvj a[B(x,fik)) ; , \\ui - u 2 \\ < e , 

where the symbol Conv designates the convex hull. In addition, we may assume 
that the sequence is non increasing. 

o o 

Denote by Kk the interior of ICk, set V k — ICk\ ICk-i f° r k > 1, and cover 
the compact set T>k with a finite collection Bk of open balls having the following 
properties : 

• each of these balls is centered at a point of T>k and is contained in the open 

o 

set /Cfc+i \/Cfc-2 (with the convention that ZC_i =0), 

• each of these balls has radius at most — — . 

2 

The union B = (Jfc>i &k is a countable locally finite collection of open balls that 
covers flj?", an d it has the property that every ball in B is included in B{x, Hk( x )) 
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as soon as it contains x. Let Bj, for j £ IN, enumerate B, and hj be a smooth 
partition of unity where hj has support suppft-j C Bj. If we pick Xj £ Bj for each 
j, the map (3 : — > -2?™ defined by 

/?(*) = £ ^(x)a(x,) (11) 
jew 

is certainly smooth. In addition, since by construction Xj belongs to B(x,/i^ x ^) 
whenever hj(x) ^ 0, we get that (3{x) lies in the convex hull of a(B(x, r)) for 
some r < Hk(x): and therefore, from (JXOj) and ([9]), that (x, (3(x)) £ and ||a(x) — 
P(x)\\ < e. Hence (3 is a smooth feedback on fi such that ||a(x) — < £ for all 

X £ OjR". □ 

3.3. Conjugacy. We turn to the notion of conjugacy for control systems, which is 
the central topic of the paper. 

Definition 3.5. Let 

x: n - » 

(x,u) h-> x(x,u) = (xi(x,u) , Xk(x,u)) 

be a bijective mapping between two open subsets of M n+m and M n +m respectively. 
We say that x conjugates systems @ and ([5]) if, for any real interval /, a map 
7 : / — > 57 is a solution of (jl]) that remains in if, and only if, x o 7 is a solution 
of ([!} that remains in Q'. 

Although this definition makes sense without any regularity assumption, we 
only consider the case when x and X -1 are at least continuous. Then Brouwer's 
invariance of the domain (see e.g. [17] ) implies that n' + m! = n + m if ([!]) and |5]) 
are conjugate via such a \. Proposition 13.61 below asserts that more in fact is true. 

Proposition 3.6. If the map x ^ n CU) * s a homeomorphism that conjugates (0]) 
to ([5]) . then n = n' , m — ml , and xi depends only on x: 

X(x,u) = {xi(x), xm(x,u)) . (13) 

Moreover, Xi '■ ^fft" ~ * ^ir*» * s a homeomorphism. Here, one should recall the 
notation fijj™ that was introduced before Definition \3.IA 

Proof. Let x, u, v! be such that (x,u) and (x,vl) belong to Q. Let further x(t) be 
a solution^ to (0]) with x(0) = x and 

u(i) = u if t < 0, 
u(t) = u' if t > . 

By conjugacy, = xi( x (*)> U W) is a solution to ([5|) with v given by u(t) = 
Xn(x(t),u(t)), for £ S (— e, e) and some e > 0. In particular xi( x (t)> u {t)) is con- 
tinuous in t so its values at + and are equal. Hence Xi(x, u) = xi(x,"u') so 
that Xi : ^j?™ — > ^iff"' * s we ^ defined and continuous. Similarly, (x~Ji induces a 
continuous inverse Q' M „t - > &>R n - By invariance of the domain n = n'. □ 

In view of this proposition, we will only consider conjugacy between systems 
having the same number of states and inputs. Hence the distinction between (n, m) 
and (n',m') from now on disappears. 

Remark 3.7. In the literature, there seems to be no general agreement on what 
should be called a solution of a control system, nor on the concept of equivalence. 
We discuss and compare some notions in use in section [ 



^This solution is not necessarily unique since here / and g are merely assumed to be continuous. 
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Remark 3.8. Taking into account the triangular structure of \ in Proposition 13.61 
one may describe conjugacy as resulting from a change of coordinates in the state- 
space (upon setting z = Xi( x )) and then feeding the system with a function both of 
the state and of a new control variable v (upon setting u = (x _1 )n(z, v)), in such a 
way that the correspondence (x, u) i— > (z, v) is invertible. In the language of control, 
this is known as a static feedback transformation, and two systems conjugate in the 
sense of Definition 13.101 would be termed equivalent under static feedback. 

This notion has received considerable attention (see for instance albeit only 
in the differentiable case (i.e. when x is a diffeomorphism) . Differentiability has the 
following advantage : when \i an d (xi) _1 are differentiable, x conjugates systems 
© and © on some domain if, and only if 

dxi 

g(xi(x),Xn(x,u)) = — (x)f(x,u) (14) 

holds true on this domain. Hence one may replace Definition 13. 101 which is based 
on solutions to © and ©, by the equality above expressing the way in which x 
transforms the equations. Note that the differentiability of xtl is not required. 

Various degrees of regularity for x give rise to corresponding notions of conjugacy 
in Definition 13.101 below. 

Definition 3.9. For k € IN U {oo,cj}, k > 1, a map x as in (H3J) is called a 
quasi-C k diffeomorphism if and only of it is C° homeomorphism and Xi is a C fc 
diffeomorphism — * f2' K 7i, i.e. xi and Xi _1 are of class C k . 

Definition 3.10. Let k G N U {oo, u},k>l. 

Systems © and © are topologically (resp. C fc , resp. quasi-C k ) conjugate over 
the pair f2,fi' if there exists a homeomorphism (resp. C k diffeomorphism, resp. 
quasi-C fc diffeomorphism) x '■ ^ — > ^' that conjugates the two systems. 

System © is locally topologically (C fc , quasi-C fc ) conjugate to system © at 
(x,u) € M n+m iQthe two systems are topologically (C fc , quasi-C fe ) conjugate over 
a pair Q, Q', where fl is a neighborhood of (x,u). 

Remark 3.11. All definitions are invariant under linear time re-parameterization, 
namely : if % : Q — ► Cl' conjugates systems © and © , then for any X £ 1R (if 
A < 7 this reverses time) the map x o-lso conjugates the systems 

x = A/(x, u) and z — Xg(z, v) . 

Indeed, this is trivial for A = 0, otherwise, if t t— > (x(t),u(i)) is a solution of 
x = Xf(x, u) on a time-interval £2], and x(t) and u(t) denote respectively x(t/X) 
and u(t/X), then t 1— ► (x(t),u(t)) is a solution of © on [Ati,Af2] 5 hence x sends 
(x(t),u(t)) to (z(t),v(t)) satisfying z(t) = g(S(t),v(t)). Consequently, x maps 
(x(t),u(t)) to (z(t),v(t)) = ((z(Xt),v(Xt))), which is a solution of z — Xg(z,v). 

In case there is no control (i e. m = m! = 0) so that neither u nor xtl appear in 
(TH21) . Definition 13 . 101 coincides with the usual notion of local conjugacy for ordinary 
differential equations. 

3.4. Properties of conjugating maps. Below we derive some technical facts 
about conjugacy and feedback that are fundamental to the proof of Theorem 15.21 
although they are not needed to understand the result itself. 

In the proof of Proposition ^. 61 we only used conjugacy on a very small class of 
solutions, namely those corresponding to piecewise constant controls with a single 

2 It would be more natural to say that system ((1) at (x,u)£ JR n+m is locally conjugate to 
system J5]l at (x' , tx')£ JR n + m if the two systems are conjugate over a pair Q, Q' , where Q is a 
neighborhood of (x,u) and CI' is a neighborhood of (x',u'). However, prescribing (x',u') would 
increase notational burden and add no relevant information. 
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discontinuity. This raises the question whether smaller classes of solutions than 
prescribed in Definition 13.11 are still sufficiently rich to check for conjugacy. Under 
mild conditions on / and <?, as we will see in the forthcoming proposition, conju- 
gacy essentially holds if it is granted for a class of inputs that locally uniformly 
approximates piecewise continuous functions, and this fact will be of technical use 
in the proof of Lemma 16.31 To fix terminology, we agree that a function / — > M m , 
where / is a real interval, is called piecewise continuous if it is continuous except 
possibly at finitely many interior points of I where it has limits from both sides 
and is either right or left continuous. If in addition the function is constant (resp. 
affine, resp. C°°) on every open interval not containing a discontinuity point, we 
say that it is piecewise constant (resp. piecewise affine, resp. piecewise C°°). 

Proposition 3.12 (Conjugacy from restricted classes of inputs). Assume that f 
and g are continuous M n x M m — > lR n and locally Lipschitz-continuous with respect 
to their first argument Let x ■ ^ - * ^' be a homeomorphism between two open 
subsets of M n+m , and denote by Jin and Q'^ respectively the open subsets of M m 
obtained by projecting Q and Q' onto the second factor. Let further C and C be 
collections of locally bounded measurable functions M — > M m whose restrictions 
C\j and C'\j to any compact interval J contain in their respective closures, for 
the topology of uniform convergence, the set of all piecewise continuous functions 
J — > f^i and J — > QL respectively. If x maps every solution (JSJ) of ^ such that 
7n(i) £ C\i to a solution of (0) while, conversely, x _1 maps every solution ([5]) of 
((5"|) such that 7j(£) G C'\i to a solution of ((¥]), then the restriction of x t° an V 
relatively compact open subset O C SI conjugates systems ^ and ^ over the pair 

o,x(o). 

Proof. Let us first show that 

for any solution 7 : 1 — > O of Q such that 711 is 
piecewise continuous, x 7 is a solution to 

Since the property of being a solution is local with respect to time, we may suppose 
that J is a compact interval. Then, there is an open set O and a compact set K. 
such that 7(1) C O C K, C 0. By the hypothesis on C, there exists a sequence of 
functions 7n,fc : / — > M m converging uniformly to 7n such that 7^ S C\i. Define 
for each fc e JV a time-varying vector field X k by X k (t,x) = f(x, 7n,fc(£)). By the 
continuity of /, this sequence converges uniformly on compact subsets of I x M n to 
X{t,x) — /(x,7n(t)); moreover, since 7n is bounded (being piecewise continuous) 
7]Lfc is also bounded, thus the local Lipschitz character of f{x, u) with respect to x 
implies by compactness that X(t,x) and X k (t,x) are themselves locally Lipschitz 
with respect to 1 on J x Ojr™. Pick to & I and apply Lemma 1X31 with I — [ti,t2], 
x o = 7i(^o): and U = Ojr™. This yields, say for k > K, that the solution 7^/. to the 
Cauchy problem 

7i, fc (t) = X k {t, lhk {t)) , 7l , fe (* ) = 7i(*o) , 

maps / into Ojj« and that the sequence (ji^^kyK converges uniformly on I to 71. 
Hence, if we let 

lk{t) = (jI,k{t),jE,k(t)), 

the sequence ("ik)k>K converges to 7, uniformly on I. In particular 7fc(I) C /C C J! 
for k large enough. 

Now, since 7^ : I — > Q, is a solution to (jlj with 7n,fc £ C\i, it follows from the 
hypothesis that x°7fe is a solution to (O that remains in f2', i.e. with the notations 



a This means that each (x,u) £ Q has a neighborhood M such that ||/(ic',«) — /(ir,u)|| < 
c \\x' — x\\ for some constant c whenever (x, u) and (x 1 , u) lie in Af ■ 
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of p^|) we have, for k large enough, 

Xi°7fc(*) - Xi°7fc(*o) = / g{x°Jk{s))ds, tel. (16) 

By the continuity of \i the convergence of 7&(£) to "f(t), and the fact that g re- 
mains bounded on the compact set x(/C), we can apply the dominated convergence 
theorem to the right hand-side of (|16[) to obtain in the limit, as k — > oo, that 

Xi°7(*) - Xi°7(*o) = / 9(x°7( s ))ds, tel. 

Thus x ° 7 : ^ ~~ * ]R n+m is a solution to ([5|) that remains in CI', thereby proving 

The next step is to observe from (fT5|) that, since piecewise constant controls are 
in particular piecewise continuous, the proof of Proposition applies to show that 
X : fi — > has a triangular structure of the form (fT5| . 

With (fT5|) and (fTUf at our disposal, let us now prove the proposition in its 
generality. Choose an arbitrary open subset O with compact closure O in Q, and 
fix two compact subsets JC and JC\ of f2 such that 

o cOca:c/cca;ic/Ci c o. 

o 

where JC stands for the interior of JC. 

Let 7 : I -> O be a solution of . We need to prove that x o 7 is a solution to 
dH) and again, since the property of being a solution is local with respect to time, we 
may suppose that / is compact. Notations being as in ffj]), it follows by definition 
of a solution that 71 is a bounded measurable function / — > M m . We shall proceed 
as before in that we again approximate 7 by a sequence 7^ of trajectories of (TJ|) 
that are mapped by x to trajectories of (0. This time, however, the approximation 
process is slightly more delicate, because it is no longer granted by the hypothesis 
on C but it will rather depend on general point-wise approximation properties to 
measurable functions by continuous ones. 

By the compactness of JC, there is e/c > such that 

(x, u) e JC B((x, u) , e K ) CKi ■ (17) 
Let m 7i : / — > IR m be an auxiliary function with the following properties : 

(i) u 7l is piecewise constant on /, 

o 

(ii) (£(t), u-ftft)) GJCi for alH 6 / and every map £ : I — > Ft n that satisfies 

sup||£(t)- 7l (t)|| <e K /2. (18) 
tei 

Such a function w 7l certainly exists. Indeed, by definition of a solution, 71 is ab- 
solutely continuous thus a fortiori continuous I — > M" , and therefore we know for 
each tei that the set 

7 f 1 (i?(7iW,^/2)) 

is an open neighborhood of t in /, hence a disjoint union of open intervals in I one 
of which contains t; call this particular interval Ut- By the compactness of /, we 
may cover the latter with finitely many intervals Ut for 1 < j < v. Let now j(t) 
denote, for each tei, the smallest index j e {1, . . . , v} such that t e Ut j . Then, 
the map 

«7lW =7k(*j(*)) 

clearly satisfies (i), and since ("yi(tj(t))> 7n(*j(t))) € O C /C, it follows from (fTTj) and 
the fact that ||7i(t) — 7i(ij(t))|| < £k;/2 by definition of j(t) that it 7l also satisfies 
(ii). 
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Next, recall that 7n is a bounded measurable function I — > M m so, by Lusin's 
theorem |21( Theorem 2.23] applied component-wise, there is, for every integer 
k > 1, a continuous function h k ■ I — > -2? m that coincides with 7n outside some set 
7fe C / of Lebesgue measure strictly less than 1/k 2 , and in addition such that 

sup||/ifc(t)|| < Vmsup||7 K (t)||. (19) 
tei tei 

o 

Put Ek = {t £ I; ("fi(t),hk(t)) £tC}- Since hk is continuous Ek is compact, and 

o _ 

since C O C/C it is clear that Ek C T/~ hence Ek has Lebesgue measure strictly 
less than 1/k 2 . Consequently, by the outer regularity of Lebesg ue measure, Ek can 
be covered by finitely many open real intervals Ik,i, ■ ■ ■ , Ik,N k whose lengths add up 
to no more than 1/k 2 . 

We now define the sequence of functions 7n,fc on / by setting, for k > 1, 

7M(*) = h k (t)i{t&I\\jf^I k!j , (2Q) 
7n,fcW = «7i(*)i f *eU5iAj. 

By construction 75, fc is piecewise continuous, and uniformly bounded independently 
of k in view of (119p and the fact that m 7i , being piecewise constant, is bounded. 
Moreover, as J2k>i V^ 2 < °°! the measure of the set l J^ 1 Ik,j is the general term, 
indexed by k, of a convergent series, hence almost every t £ I belongs at most 
to finitely many of these sets so that 7n,fc converges point-wise a.e. to 71 on / as 
k — > 00. 

Redefine now X k (t,x) = fix, 7n,fc(i)), X(i,x) = /(a;, 7n(*)) 5 and observe from 
what we just said and the continuity of / that X k (t,x) converges to X(t,x) when 
k — ► 00, locally uniformly with respect to x £ Or™, as soon as t (£ E where 
E C / is a set of zero measure which is independent of k. Moreover, again from 
the boundedness of 71, 711 and the local Lipschitz character of /, we have that 
X k (t,x), X(t,x) are locally Lipschitz with respect to x. Pick to £ I and apply 
Lemma fA.31 with U — Or™, I = \ti,t^[, and xq = 71 (to)- We get, say for k > K, 
that the solution 71^ to the Cauchy problem 

7i, fc (t) = X k {t llhk {t)) , 7i,fe(*o) = 7i(«o) , 

is defined over /, maps the latter into Or™, and that the sequence (7i,fe)fe>if con- 
verges uniformly on \t\, t%\ to 71. 

o 

We claim that 7&(t) = (7i,fc(i), 7n,fc(i)) lies in Ki for all t £ I when k is so large 
that 

sup||7i,fe(i)-7iWII <e/e/2. (21) 
tei 

Indeed, ift£ Ujlkj, this follows automatically from definition f2"U|) by property (ii) 

o 

of u 7l ; if t ^ Ujlk.j, then (7i(<), hk{t)) £K by the very definition of Ujlkj, and since 

o 

7*W — {ji,k(t),hk(t)) in this case, we deduce from (JTTJ) and (J^U) that 7fc(t) G/Ci- 
This proves the claim. 

o 

Altogether, we have shown that jk '■ I — */Ci is a solution of (jl]) as soon as A; is 
large enough, with 7^ a piecewise continuous function on / by construction. By 
(fl~5| . we now deduce that, for k large enough, j' k — \ 7fc is a solution of ([5|) that 
stays in f2'. Let us block-decompose 7I into 



7i',fe(*) = Xi(7i,fc(*)), 7n,fc(*) = Xn(7i,fe(*) , 7n,fc(*) ) > 
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where we have taken into account the triangular structure of X- That "f' k : I —>■ Q' 
is a solution of ([5]) means exactly that 

TU*) - tW*o) = 1 9H,k(s),lkk{s))ds, tel. (22) 

J t 

Due to the continuity of x, the functions 7j fc and 7j k respectively converge uni- 
formly and point-wise almost everywhere to 7j = xi°7i and 7n = Xn°7 on /. Since 
5 is bounded on the compact set x(/Ci) that contains 7fe(/) for fc large enough, we 
get on the one hand, by dominated convergence, that the right-hand side of (|2"2")l 
converges, as k — > oo, to <?( 7i'(s) , 7^(5) )ds, and on the other hand that the 
left-hand side converges to 7j(t) — 7 I (to)- Therefore (7^,7^) = Xo7 : I — ► fl' is a 
solution of (O. 

This way we have shown that x maps any solution of {2} that stays in a relatively 
compact open subset of SI to a solution of (j^J) that stays in SI'. This achieves the 
proof, for the converse is obtained symmetrically upon swapping / and g, C and C, 
and replacing \ by x~ • D 

The triangular structure of conjugating homeomorphisms asserted by Propo- 
sition 13.61 is to the effect that any such homeomorphism x : ^ — > ^' is a fiber 
preserving map from the bundle SI — * fijjn to the bundle SI' — > Sl^„. Since feed- 
backs are naturally associated to sections of these bundles by Definition 13.31 x 
gives rise to a natural transformation from feedbacks on SI to feedbacks on ST. This 
transformation will prove important enough to deserve a notation : to any feedback 
a on SI, we associate a feedback x" a on SI' by the formula 

X*a(z) = xi(xr 1 ( 2: ) J a(xr 1 (2 ; ))) ■ (23) 

We leave it to the reader to check that the properties of an action are satisfied, and 
in particular that 

X" 1 ■(*■«) = a. (24) 
Naturally associated to a control system (H|) and a feedback a is the following 
continuous vector field f a on Sljpn : 

f a (x) = f(x,a(x)) . (25) 

If the homeomorphism x m (O conjugates system ^ to system ([5]), then it is 
clear that xi maps the solutions of the ordinary differential equation x = f a (x) 
to the solutions of the ordinary differential equation z = g x ma{z). Indeed if x(t) 
is a solution of the former, then (x(t),a(x(t))) is a solution of the control sys- 
tem ((H) in the sense of Definition 13.11 so the conjugacy assumption implies that 
(Xi(x(t)), xn(x(t), a(x(t)))) is a solution of ([5|), and setting z(t) = xi{ x (t)) onc 
clearly has Xn(x(t),a(x(t)))) — x"a(£(0); hence z(t) is a solution to z = g x ua{ z ) 
because (z(t),x*&(z(t))) is a solution of |5]). 

Now, if ol\ and «2 are two feedbacks on O, and the two vector fields f ai and f a2 
are defined on Sljjn by (|25p . we denote their difference by (5/ QljQ2 : 

^fai,a 2 — feci fai ■ (26) 

Such vector fields are similar to the difference vector fields used in [IS] , except that 
we consider arbitrary feedbacks instead of constant ones. To us, these vector fields 
will play an essential role. The next proposition states that a homeomorphism that 
conjugates two control systems also conjugates the integral curves of such difference 
vector fields. 

Proposition 3.13 (preservation of difference vector fields). Suppose that f and g 
in Q and (JSJ) are continuous and locally Lipschitz continuous with respect to their 
first argument. Assume they are locally topologically conjugate at (0,0) over the 
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pair fl, S7'. Then, notations for xi a> n d Xn being as in Provosition 1 3. 61 we have for 
every pair of feedbacks cti,a 2 on 51 that xi conjugates any solution of 

x = Sf aua2 (x) (27) 

that remains in rijR« to a solution of 

z = 8gxMa 1 ,xma 2 i z ) (28) 

that remains in . 

It is perhaps worth emphasizing that the solutions of (|27p and (|28p need not be 
unique since a is merely assumed to be continuous. 

Proof. Let 77 : \t\, t 2 ] — * ^e* be an integral curve of Sf ai ^ a2 , and set 

ui(i) = 01 (»;(«)) , «2(i) = a 2 {r){t)) . (29) 

Let further / : M n+m — > J? n be bounded, continuous and Lipschitz continuous with 
respect to its first argument, and coincide with / on some compact neighborhood 
of 



v([tiM) x («i (»?([*!, *a])) (J «a(»/([ti,*2])) 



Such a / is easily obtained upon multiplying / by a function of class C°°with 
compact support. For I <G IN, let rf be the solution to the Cauchy problem 

rf{t) = r,(h) + [ G t {T,rf(j))&r , (30) 
Jti 

with 

G e (t,x) = 2f(x, Ul (t)) 

if te[h + j(t 2 - ti),h + (f + £)(t 2 - ti)), 

G*(t,aO - -2/(x, U2 (t)) (31) 

if t € [ti + (i + - h),h + i±i(i 2 - ii)), 

Gi(t 2 ,x) = -2/i>,u 2 (i 2 )), 0<j<4-l. 

The definition of rf is valid because, since Gi{t, x) is bounded and locally Lipschitz 
with respect to the variable x, the solution to (|30p uniquely exists. 

From Lemma lA.4l applied to the case where X 1,e (t. x) = f{x,u\{t)) andX 2, {t, x) ■ 
f{x, u 2 {t)) are in fact independent of £, any accumulation point of the sequence {rf), 
say rj°° , is a solution to 

v°°{t) = K^{t), Ul {t)) ~ f{^{t),u 2 {t)) , n°°{t{) = v{h) ■ 

Since / is locally Lipschitz continuous with respect to its first argument, the so- 
lution to this Cauchy problem is unique and, since / and / coincide at all points 
{r]{t),ui{t)) and (r?(i), u 2 {i)), this entails 77°° = 77. Thus [if) converges uniformly 
to rj on [ii,i 2 ] and, for I large enough, rf remains a solution of (f30|) if / is replaced 
by / in (f3Tj) . Moreover, rj {[ti,t 2 ]) C SIm™ for £ large since the same is true of 77. 
Since x conjugates the two systems, hence also by Remark l3.11l the systems where 
/ and g are multiplied by 2 or —2, the map x\ OT f '■ [^lj^a] ~~ ¥ is, for I large 
enough, a solution to 

Xl°rf{t) = X i°r){ti) + f ^(r, X io^(r))dr (32) 
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with 

G t (t,z) = 2g{z, X ii(Xi 1 (z) 7 u 1 (t))) 

if t e [h + §(t 2 - h),ti + (f + £)(ta - ti)), 

G,(t,*) = -2.g(z, Xn (xr 1 W,«2(i))) (33) 

if t e [h + (| + £)(ta - ti), ti + ^(ta - 

Gi(t 2 ,z) = -2g(z,\Ti(Xi 1 (z),U2(t2))). 

Since (xi ° ?7 ) converges uniformly to \i ° V by the continuity of %i replacing g by 
a bounded and continuous g : M n+m — > JR™ that coincides with j on a compact 
neighborhood of 

Xi°V([hM) x (xn('K[ii^2]),ai(r/([ti,t 2 ]))) |J XiMMa]), a 2 (?7([ii, t 2 ])))) 

does not affect the validity of (I32| - (l33|) for I large enough. Lemma [A. 41 now implies 
that all accumulation points of the sequence (\i ° V ) m the uniform topology on 
[ti,t 2 ] are solutions of 

z = 5(^,Xn(xr 1 ( ;2 )''"i(*))) ~ 5(^,Xn(xf 1 ( z ) J '"2(t)))- 
Because xi ° ^ is such an accumulation point, it is by (|29p a solution to 

z = g{z,x-n(Xi 1 (z),ai(xi 1 (z))) - g(z,x-n(xi 1 (z),a 2 (xi 1 (z))) , 
which is nothing but (|28[), □ 

3.5. Alternative notions of conjugacy and equivalence. 

3.5.1. Transformations in functional spaces. Following [7], one may view the con- 
trol system (j4j) as a flow on the product space M n x U, where U is a functional 
space of admissible controls whose dynamics is induced by the time-shift. Trans- 
formations on M n x IA then naturally arise; they involve the future and the past of 
the control, unlike the mere homeomorphisms on finite dimensional spaces that we 
consider here. The corresponding notion of equivalence is obviously rather weak. In 
[3], a "Grobman-Hartman theorem" theorem is proved in this setting, i.e. generic 
control systems (j4j are locally conjugate to a linear system via this kind of trans- 
formation. With the much stronger notion of equivalence that we use here, we shall 
see (section [5 .4[) that "almost" no system is conjugate to a linear system. 

Let us also mention [S], where control systems are maps (x(0), I— * x (-) that 
satisfy certain axioms, without reference to differential equations, and where the 
notion of topological equivalence involves transformations on the product M n x hi. 

3.5.2. x- conjugacy. Let us call x-solution of system Q any map 1 1— ► 71 (i) such that 
there exists a map 7n for which 7 = (71,71) is a solution in the sense of Definition 
13.11 the set of x-solutions is the projection on the x factor of the set of solutions. Let 
then :z;-conjugacy be defined in the same way as Definition 13.101 defines conjugacy, 
except that we replace solutions by absolutions and the homeomorphism x that acts 
on state and control with a homeomorphism x <— > z — h(x) on the state only. 

In the literature, both notions are used (without the prefix "x-"). For instance 
[2"§] , devoted to the topological classification of linear control systems (see section 
14. 2p relies on x-conjugacy. We favor Definitions 13.51 and 13.101 of conjugacy and 
solutions because results have to be stated locally with respect both to x and u for 
nonlinear control systems. 

Conjugacy implies x-conjugacy: use Proposition ^. 61 take h = Xi and ignore xtl- 
The converse is not true in general, as the reader may check easily. 
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4. The case of linear control systems 



4.1. Kronecker indices. A linear control systems is a special instance of (j3J), of 
the form 

x = Ax + Bu (34) 

where A and B are constant n x n and n x m matrices respectively. When dealing 
with linear systems, it is natural to consider an equivalence relation similar to that 
of Definition 13.101 but where x is restricted to be a linear isomorphism : 

Definition 4.1. Two linear systems 

x = Ax + Bu and i = Az + Bv 

are linearly conjugate if and only if any of the following two equivalent properties 
is satisfied : 

(1) There is a nonempty open set f2 C M n+m , and a linear isomorphism y of 
M n+m whose restriction il — > x(fi) conjugates the two systems in the sense 
of Definition EIL0] 

(2) There exist matrices P G M nXn , Q e ]R mxm and K S M nxm , with P and 
Q invertible, such that 



A = P(A — BK)P~ X 
B = PBQ- 1 . 



(35) 



Since, by Proposition 13.61 a linear conjugating homeomorphism is necessarily 
of the form (x, it) i— ► (Px,Kx + Qu), the equivalence between properties (1) and 
(2) follows at once from differentiating the solutions. Provided it exists, SI plays 
absolutely no role in this context since J35|) implies that the two systems are in fact 
linearly conjugate on all of M n+m . 

Linear conjugacy actually defines an equivalence relation on linear control sys- 
tems or equivalently on pairs (A, B), for which ([35]) can be read as "(A,B) is 
equivalent to (A, B)" . The classification of linear systems under this equivalence 
relation is well-known [3], and goes as follows. Each equivalence class contains a 
pair (A c , B c ) of the form (block matrices) : 



A r 



where 



AS = 



( Al 
A\ 

V 



/ 1 



V o 



••• \ 


A c m J 
\ 


1 

... / 



B r 



( o 



\ 



(36) 



V : 6^/ 



m = 



/ \ 



1 < i < to. (37) 



(KjXl) 



The integers (ki, . . . , K m ) are called the controllability indices of the control system, 
also known as the Kronecker indices of the matrix pencil (A, B), while Aq is a square 
matrix of dimension n — (k± + • • • + K m ) that may be assumed in Jordan canonical 
form. Note that «! + ••• + K m < n, and if K\ + • • • + n m = n there is no Aq ; also, it 
may well happen that Ki = 0, in which case A\ and b\ are empty and do not occur 
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in ((5b]) to the effect that there are less than m blocks beyond Aq. Normalizing so 
that 

Ki > ■ ■ ■ > K m > 0, 

and ordering the Jordan blocks arbitrarily, there is one and only one such normal 
form per equivalence class. A complete set of invariants is then the list of Kronecker 
indices and the spectral invariants of the matrix Aq. 

With the natural partition z = {Zq, Z\, . . . , Z m ) corresponding to the block 
decomposition ([5fa]) . the control system associated to the pair (A C ,B C ) reads 

Zo = AqZq , Z\ = A\Z\ + u\b\ , ■ • • , Z m — A m Z m + u m bm , 

where Zq is missing if K\ + • • • + n m = n and Zi is missing if k% =0. Because it is not 
influenced at all by the controls, Zq is sometimes called the non-controllable part 
of the state. In this paper, we are only interested in controllable linear systems, 
namely : 

Definition 4.2. A linear control system (j3"4"|) is said to be controllable if, and only 
if, the following two equivalent properties are satisfied : 

(1) There is no bloc Aq in the associated normal form (|36[) . 

(2) Kalman's criterion for controllability : 

Rank(B, AB, A n ~ l B) = n. 

To see the equivalence of the two properties, observe that the n — k\ — • • • — K rn 
first rows of the matrix P that puts (A, B) into canonical form (i.e. z — Px) form 
a basis of the smallest dual subspace that annihilates the columns of B and at 
the same time is invariant under right multiplication by A, i.e. they are a basis 
of the left kernel of (B, AB, . . . , A n ~ 1 B). For controllable linear systems, the only 
invariant under linear conjugacy is thus the ordered list of Kronecker indices. These 
can be computed from (B, AB, . . . , A n ~ 1 B) as follows : if we put 

Tj = Rank(S, AB, ... , A>- X B) , j > 1 , r = 0, r_ x = -m , 

Sj = Tj - rj-1 , j > 1 , Sq = HI , 

then Sj does not increase with j and a moment's thinking will convince the reader 
that the number of Kronecker indices that are equal to i is Si — Si+i, or equivalently 
that Sfe is the number of Kj's that are no smaller than k. 

To us, it will be more convenient to use as normal form the following permutation 
of the previous one. Let p be the smallest integer such that s p = 0, so that 

= s p < ,s p _i < s p _ 2 < • • • < si < s = m , 

with sj = n. From these we define, for < i < p : 

i>i 

o~i = /^Sj = n~ r. ( _i , (39) 

j>i 

so that in particular a p = 0, (7 p -i = s p _i > 0, a± = n and <to = n + m - Note that, 
from (|3"5|) . o~i = n — r^_i for i > 1. We shall write our controllable canonical form 
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as z = A c z + B c v with 



" S n - 



jSp-2 



7 



V 




B c = 



I s 1 



\ 



(40) 



where for any integers r and s with s < r, J£ is the s x r matrix 





f 

Is 


\ 




(41) 






J 





where / s is the s x s identity matrix. 

4.2. Topological classification of linear control systems. In [29 , which is 
devoted to the topological classification of linear control systems and uses the 
notion of x-conjugacy rather than conjugacy ( cf Section 13. 5p . the following result 
is proved: 

Theorem 4.3 (Willems [29])- If two linear control systems x — Ax + Bu and 
z = Az + Bv are topologically x-conjugate, then they have the same list of Kronecker 
indices, and the non- controllable blocks Aq and Aq in their respective canonical 
forms (|36p are such that the two linear differential equations Xq = AqXq and 
Zq = AqZq are topologically equivalent. 



As pointed out in Section l375l topological conjugacy implies topological ir-conjugacy 
but not conversely. However, for linear control systems having the same number 
?7i of inputs, Theorem 14.31 implies that these notions are equivalent. Indeed, if 
two systems are respectively brought into their canonical form (|36[) by a linear 
change of variable on lR n+m , and if in addition they are x-conjugate, then their 
non-controllable parts are topologically equivalent while the remaining blocks are 
identical by equality of the Kronecker indices. Hence, both in the above theorem 
and in the corollary below, one may use indifferently "x-conjugate" or "conjugate" 

Corollary 4.4. If two linear systems x = Ax + Bu and z = Az + Bv are topolog- 
ically conjugate and one of them is controllable, then the other one is controllable 
too and they are linearly conjugate. 

Proof. Controllability is preserved, since Kronecker indices are by the theorem. 
Linear conjugacy follows, as we saw that the list of Kronecker indices is a complete 
invariant for controllable systems under linear conjugacy. □ 
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In some sense, the results of section [5] can be viewed as a generalization of 
Corollary 14.41 to a local setting where only one of the two systems is linear. 

5. Local linearization for control systems 

In this section, we consistently assume that the map / defining system @ is 
either smooth or real-analytic. 

Definition 5.1. Let k € {oo,lj}. The system @ is said to be locally topologically 
(resp. C , resp. quasi-C ) linearizable at (x,u ) e R n+m if it is locally topologically 
(resp. C k , resp. quasi-C k ) conjugate, in the sense of Definition 13.101 to a linear 
controllable system i = Az + Bv (cf. Definition 14. 2[) . 

This definition of smooth linearizability coincides with linearizability by smooth 
static feedback as described in the textbooks [THl EH] ■ In subsection 15.21 we recall 
classical necessary and sufficient geometric conditions for a system to be smoothly 
(resp. analytically) linearizable, and we complement them with a characterization 
of quasi-smooth (resp. quasi-analytic) linearizability. 

5.1. Main result. If a smooth control system is locally topologically linearizable, 
then the conjugating homcomorphism has a lot more regularity than required a 
priori. This is in contrast with the Grobman-Hartman theorem for ODE's and 
constitutes the central result of the paper: 

Theorem 5.2. Let k S {oo,w} and assume that f is of class C k on an open set 
CI C ]R n+m . Then system (j4|) is locally topologically linearizable at (x,u) 6 CI if, 
and only if, it is locally quasi-C k linearizable at (x,u). 



Proof. See section [6721 □ 

Observe from (|14p . that a quasi-C fe diffeomorphism x is a linearizing homeomor- 
phism if and only if it satisfies 

^(x)f(x,u) = A X i(x) + B X tl(x,u) . (42) 

Hence quasi-smooth linearizability is much easier to handle than topological lin- 
earizability, that relies on conjugating solutions rather than equations. 

System (fTJ of the introduction is topologically, quasi-C"'' and quasi-C 00 linearizable 
at (0, 0) but fails to be even C 1 linearizable; hence quasi-C fc cannot be replaced with 
C k in Theorem l5.2l To study the gap between C k and quasi-C fe linearizability, note 
that (|42p imposes additional regularity on a linearizing quasi-C fc diffeomorphism : 

Proposition 5.3. Let k E {oo,o;} and f in (jl]) be C k . Lfx ■ ^ — > il' is a quasi-C k 
diffeomorphism that conjugates (j4|) to the linear system i = Az + Bv, then : 

(1) the map B\i '■ ^ — > H m is of class C k , 

(2) for any (x,u) £ CI in the neighborhood of which the rank of df/du is con- 

df 

stant, one has Rank — (x.u) = Ranki?. 
ou 

df 

(3) for any open subset O of CI, one has sup Rank — — (x 1 ,u') = RankB. 

(x',u')eo 9u 

Proof. Point ([T|) is direct consequence of (|4"2"]) and the smoothness of %i and /. To 
establish and ([3]), differentiate (jUJ) with respect to u to obtain 

- <«» 

Let V C CI be open and such that Ka,nkdf/du(x, u) = p some integer p and all 
(x,u) e V. Define <f> : V -> M n+m by <j>(x,u) = {xi{x), B X tl{x,u)). On the one 
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hand, since xi is a diffeomorphism, (|43[) implies that the rank of the Jacobian of cj> is 
n + p, hence, by the constant rank theorem, <^>(V) is a (n + p) dimensional immersed 
sub-manifold of M n+m ; on the other hand, since x is open, 4>{V) is an open subset 
of the (n + Rank£?)-dimensional linear range of /„ x B; hence p — RankS. This 
proves point and at the same time point [3] because any Oc!! contains an open 
subset on which the rank of df /du is constant while (|43|) clearly implies that, for 
all (x, u) £ SI, the rank of df /du(x, u) is no larger than RankS. □ 



Based on Proposition 15.31 let us divide the points of SI into three classes. 

• A point (x, u) £ f2 is called regular if it has a neighborhood on which df / du 
has constant rank. It is easy to see that regular points form an open dense 
subset of SI. 

• If (x,u) is not regular, it is termed weakly singular if each neighborhood 
O C SI of this point satisfies 

df 

sup Rank — — (x,u) — m. (44) 
(x,u)eo ® u 

• A point [x, u) £ SI which is neither regular nor weakly singular is said to 
be strongly singular. This means it has a neighborhood O C SI, such that 

df df 
sup Rank — — (x, u) = m! < m , Rank —(a;, u) < m . (45) 
(x,ti)eO vu du 

The distinction between topological and smooth linearizability may now be ap- 
proached via the following theorem that complements Theorem 15.21 

Theorem 5.4. Let k £ {oo, cu} and f be of class C k on an open set SI C M n+m . 

• System ^ is locally C k linearizable at {x, u) £ fi if, and only if it is locally 
topologically linearizable at (x,u) and the latter is a regular point. 

• If © * s locally topologically linearizable at (x,U) and the latter is a weakly 
singular point, then a linearizing homeomorphism around (x, u) may be cho- 
sen to be a map of class C fc , although not necessarily a C k diffeomorphism 
(its inverse may fail to be C k '), 

Proof. The first assertion is a consequence of Theorem 15.21 together with Theo- 
rems [5?7] and [5?U to come, observing that condition ([2?J in the latter will automat- 
ically hold at a regular point by the constant rank theorem. Next, assume that 
X ■ SI — > Q' is a quasi-C fc diffeomorphism that conjugates the C k system © to the 
linear controllable system i = Az + Bv at some weakly singular point (x,u). By 
(3) of Proposition 15.31 the rank of B is m hence it is left invertible; by (1) of the 
same proposition, xn is indeed C fc . □ 

Whether Theorem l5.4l remains true if "weakly singular" gets replaced by "strongly 
singular" is unknown to the authors. This turns out to be equivalent to the follow- 
ing question in differential topology which is of interest in its own right and seems 
to have no answer so far. 

Open Question 5.5. Let O be a neighborhood of the origin in Ft p+q and F : O — * 
IR P a smooth (resp. real- analytic) map. Suppose G : O — » M q is a continuous map 
such that F x G : O — > IBP x lR q is a local homeomorphism at 0. 

Does there exist another neighborhood O' C O of the origin and a smooth (resp. 
real-analytic ) map H : O' — > M q such that F x H : O' — > M p x M q is still a local 
homeomorphism at ? 

If the answer to the open question was yes, then Definitions 15.11 and 13.91 of 
quasi-smooth (resp. quasi-analytic) linearizability might equivalently require x to 
be smooth (resp. analytic) because, assuming the linear system is in normal form 
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(|4T)f - (l4*Tj) . one could set F = n n+Sl o x and smoothly (resp. analytically) redefine 
the last m — s\ components of x- 

If the answer to the open question was no, then Definition 15.11 would really be 
more general than the one obtained by restricting x to be smooth (resp. analytic). 
Indeed, if F provides a counterexample to the open question, say, in the C°° case, 
we may consider on M p x O the control system 

x = F{u) , ue M p+q (46) 

which is locally quasi-smoothly lincarizablc at the origin because the local homeo- 
morphism 

(x,u) i-> {z,v) = (x,F(u),G(u)) 

conjugates (14*6"]) to 

z = Bv, with B = (I p |0). (47) 
However, no smooth homeomorphism 

X : (x,u) i-> ( z ,v) = (xi(x),xi{x,u)) 

exists that quasi-smoothly linearizes (|4"6"|) at 0: if this was the case, by Corollarv l4.4 
we may assume up to a linear change of variables that x conjugates (|4*b]l to (J4"?|) . 
Then conjugacy would imply 

dx 



whence in particular 



-^-(x)F(u) = Bxjl(x,u) 



F{u) = 1-^(0)] B X n(0,u), 



and the last q components of xn(0i u ) would yield a smooth H such that F x H is 
a local homeomorphism at in R p+q , contrary to the assumption. 

5.2. Geometric characterization of quasi smooth linearization. Let X and 

U be two open subsets of M n and M m respectively, and assume that / is defined 
on X x U. For each u S M" 1 , let f u be the vector field on X defined by : 

f u (x) = f(x,u). (48) 

Also, for each (x,u) £ X x U, we define below a subspace D(x,u), that coincides 
with the range of the linear mapping df/du(x,u) when its dimension is locally 
constant. First, we consider the subset C x u C M n (not a vector subspace) given 
by: 

3(w n ) £ U M , lim w n = u (49) 

and lim fe<! Z fe^j = y - 
n-oo ||/(x,m;„) - f(x,u)\\ 

subsequently we put 

D(x,u) = Spanjfj^^ . (50) 

In words, D(x,u) is the vector space spanned by all limit directions of straight 
lines through f(x,u) and f(x,u') as u' approaches u in M m ; it is of common use 
in stratified geometry to generalize the notion of tangent space. Note that the set 
£ x ,u depends on the norm used in (|49[) . but the subspace D(x,u) does not. 

Proposition 5.6. // / is of class C°° and if we denote by Rani the range of a 
linear map L, we have that 

df 

D(x,u) D Ran -Ma;, u) (51) 
ou 
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and equality holds at every (x,u) where the rank ofdf/du(x,u) is locally constant 
with respect to u. 

Proof. The inclusion ([5lTl holds because any nonzero element of Ran<9//<9u(x, u) 
can be written df/du(x,u).h for some h in IR m , and one has 

df/du(x,u).h f(x 1 u + th) — f(x,u) 



\\df/du (x, u).h\\ t^o+ \\f(x, u + th) — f(x, u)\\ 

Now fix (x, u) and assume that the rank of df/du is locally constant around (x, u), 
equal to r < ra and use the constant rank-theorem. Up to a permutation of 
coordinates, 

(hi, . . . , h m ) £ (/i(x, u + h) - fi(x,u), . . .,f r (x,u + h) - f r (x,u), h r+ %, . . .,h m ) 

is a local diffeomorphism around zero in M m and, setting p = A -1 o z o A with z 
given by z(wi, . . ■ , w m ) = (wi, . . . , w r , 0, . . . , 0), there is a constant c such that 

\\p(h)\\ <c\\f(x,u + h)-f(x,u)\\ and f(x,u + p(h)) = f(x,u + h) (52) 

for all h. Take y £ £a; iU ; by definition, there is a sequence (h n ) converging to zero 
and satisfying (|49p with w n = u + h n ; from (|52p . we may re- write it as 

y= lim f(x,u + p(h n )) - ||p(fe»)H , g3 v 

n^oo ||p(^n)|| ||/(a;,u + /i n ) - 

where both ratios are bounded; extracting a sequence such that both converge, 
the limit of the first ratio is, by definition of the derivative, u).h with h a 

limit point of p(h n )/\\p(h n )\\; hence y £ R&ndf /du (x, u). We have proved that 
Ac,« C Haxidf /du (x, u). From this implies the reverse inclusion of (|5"Tj) 

because the left-hand side is a linear subspace. □ 

We can now characterize smooth (resp. analytic) and quasi-smooth (resp. quasi- 
analytic) lincarizability in parallel. The proofs are given in section f6. II 

Theorem 5.7 (smooth or analytic linearizability). Let k £ {oo, u)} and f be of class 
C k on an open set il C M n+m . The control system ((4| is locally C k linearizable at 
(x,u) £ if and only if there are open neighborhoods X andlA of x and u in lR n 
and lR m , with X x U C Q, such that the following conditions are satisfied. 

(1) D(x, u) does not depend on u for (x, u) £ X x hi. 

df 

(2) The rank of -—(x,u) is constant in X xlA. 
w J du y ' 

(3) Defining on X the distribution Aq by Aq(x) — D(x 1 u) — this is possible 
if point (QP holds true — and inductively the flag of distributions (Afc) by : 

A fc+1 = A fc + [f n , A fe ] (54) 

where [ , ] denotes the Lie bracket, then each Afe for < k < n — 1 is 
integrable (i.e. has constant dimension over 1R and is closed under Lie 
bracket) and the rank o/A„_i is n. 

Theorem 5.8 (quasi-smooth or quasi-analytic linearizability). Let k £ {<x>,oj} 
and f be of class C k on an open set D, c M n+m . The control system Q is locally 
quasi-C k linearizable at (x, U) G f2 if, and only if there are open neighborhoods X 
and U of x and u in M n and M m , with X x hi C f2, such that conditions (Qp and 
(0) of Theorem \5. 7| are met and, instead of condition (0), it holds that 
(2') Denoting by t\ <m the constant rank of Aq, the mapping 

F : X x U -► X x M n , , 

(x,u) i-* (x, f{x,u)) 



22 



LAURENT BARATCHART AND JEAN-BAPTISTE POMET 



restricts to a C° fibratioi^ W — > F(W) with fiber IR m Tl on some neigh- 
borhood VV of (x,u) in X xLi . 

Theorem l5.7l is of course equivalent to the results in p~2l EJ [27] , but the conditions 
are stated here in a slightly different form to parallel Theorem 15.81 

Corollary 5.9. Assume that f is real analytic on some open set fl C IR m . If 
the control system ((3|) is locally C°° (resp. quasi-C°° ) linearizable at (x,u) € CI, 
then it is also C u (resp. quasi-C^ ) linearizable there. 

Proof, analyticity does not appear in the conditions of the theorems, except for the 
regularity of / itself. □ 

5.3. Linearization versus equivalence to the linear approximation. For a 

control system, smooth linearizability at an equilibrium implies conjugacy to its 
linear approximation: 

Proposition 5.10. Let (x,u) be an equilibrium point of i.e. f(x,u) — 0, and 
let A = df/dx (x, u), B = df/du (x, u) so that : 

f(x, u) = A (x — x) + B (u — u) + e(x — x,u — u) , (56) 

where e is little o(|jx — x|| 4- ||u — u||). 

If system @ is locally smoothly linearizable at (x,u), then: 

1. its linear approximation (A, B) is controllable (cf. Definition \4.tty , 

2. the system is smoothly conjugate to (A,B) at (x,u). 

Proof. Let x be a local diffeomorphism conjugating system (0| to i = Az + Bv at 
(x,u), and observe from (|14p in Remark 13.81 that smooth linearizability translates 
into flU]). If we write / as in (JSU), and if we set P = ^(x), K = ^-(x,u), 
Q = u), we get by differentiating (|42|) with respect to x and u at (x,u), 

using the relation f(x,u) — 0, that 

PA = AP + BK , PB = BQ . 

Since P and Q are square invertible matrices by the triangular structure of x 
displayed in (fT"3"f . this implies that the linear systems (A, B) and (A, B) are linearly 
conjugate, see ([3"S"|). Since (A,B) is controllable by definition so is (A, B), thereby 
achieving the proof. □ 

Proposition ^ . 101 has no analog if the control system is only topologically lineariz- 
able (hence quasi- smoothly linearizable according to Theorem 15. 2|l . For example, 
the system ([T]) in the introduction is quasi-C"linearizable at (0,0), but its linear 
approximation x = is not controllable and it is not topologically equivalent to 
x = 0. Apart from such degenerate cases, there also exist systems that are quasi- 
analytically linearizable at some point with controllable linear approximation there, 
and still they are not conjugate to this linear approximation. An example when 
m = n = 2 is given by : 

X\ = U\ , X2 = xi + u 2 , 

This system is quasi-analytically conjugate at (0, 0) to 

h = vi , z 2 = v 2 , (57) 

via z — x, v\ — iti, i)2 — U2 + x\. However, its linear approximation at the 
origin is x\ = u\, X2 — x±, which is controllable yet not conjugate to (|57p (cf 
Theorem OJ). 

^ A C° fibration with fiber T over B is a continuous map g : £ — > B for which every t; 6 B has 
a neighborhood O in B such that g~ 1 (C) C £ is homeomorphic to O X T, the so-called trivializing 
homeomorphism ip : g —1 (0) — + O X T being such that it o ip = g where n : O X T — > O is the 
natural projection onto the first factor. 
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5.4. Non-genericity of linearizability. Except when to > n or (n,m) — (2,1), 
the conditions of Theorem 15.71 require a certain number of equalities (involving 
/ and its partial derivatives) to hold everywhere. For example, the integrability 
of a distribution entails that all Lie brackets be linearly dependent on the original 
vector fields, i.e. certain determinants must be identically zero. This makes smooth 
(resp. analytic) linearizability of a smooth (resp. analytic) control system highly 
non-generic in any reasonable sense, because when written in proper jet spaces it 
is contained in a set of infinite co-dimension. Moreover, small perturbations of 
a system that does not satisfy these condition will not satisfy them either, while 
most perturbations of a system which satisfies them will fail to do so. Compare for 
instance |26] where it is shown that the equivalence class of any system affine in 
the control has infinite co-dimension in some Whitney topology. 

From Theorem 15.41 quasi-smooth or quasi-analytic linearizability, hence also 
topological linearizability by Theorem 15. 2\ require the same equalities to hold on 
an open dense set, although this time some singularities are allowed. This is no 
more "generic" than smooth linearizability, as opposed to ODE's for which the 
Grobman-Hartman theorem allows one to linearize around an equilibrium as soon 
as it is hyperbolic. 

6. Proofs 

6.1. Proof of Theorems 15.71 and 15.81 We begin with a lemma whose cumber- 
some index arrangement will be rewarded later when constructing the Kronecker 
indices of the linearized system. 

Lemma 6.1. Let k £ {oo, lu}. Let Ao and f a be respectively a distribution and 
a vector field, both of class C k on a connected open neighborhood of x € lR n . 
Let further Aj ; i > 0, be the distributions defined according to (|54p . and set for 
convenience A_i = {0}. Assume they satisfy point |3J) of Theorem \5.7\ or \5.8l Put 

Ti = RankA.;_i , i > 0, ro = 0, r_i = —to, (58) 

so that ri — n for some i < n~ 1; let p € {3, . . . , n + 1} be the smallest integer such 
that r p -i = n. Define also 

p 

Si = n- n-i , Ui = Sj r = n - r,_i , < i < p (59) 

(note that s p = a p = 0). 

Then, there exists coordinates Xii •••iXn of class C k on a neighborhood X of x 
such that 

• Xli ■ • ■ i Xui are independent first integrals of Aj_2 for i G {1, . . . , p — 1}, 

• Xm+j = fuXa i+1 +j for all integers i,j,2<i<p-l,l<j<Si 
(faXa-i+i+j * s ihe Lie derivative of the function X&i+i+j along the vector field f a ). 

Proof. Note that when i = 1, the first point above means that Xi> ■ • ■ iXn are indeed 
local coordinates. Now, the Frobenius theorem provides us with n — r independent 
C k first integrals for a C k integrable distribution of rank r. This accounts for the 
regularity of the coordinates if we construct them as follows. 

First pick n — r p -2 = o~p-i independent first integrals of A p _3 and call them 
Xi, ■ ■ ■ ,X<t„-i; define further Xi+(t p -i, ■ ■ ■ , X2 CTp _i by X<y P -i+j = faXj fOT 1 < 3 < 
o- p -i = Sp-i. Clearly, xi, • • • , Xo- P -i+s p _i satisfy the conditions for i = p — 1. Then 
proceed inductively : assume that, for some Iq € {2, ...,p— 1}, the functions 
Xi) ■ ■ ■ iXoi +s iQ have been constructed and satisfy the conditions for % > iq. We 
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claim that the differentials A\i are linearly independent at each point of X . Indeed, 
assume that there is x € X and real coefficients fij and such that 

(Tig <Ti(, 

J2^d Xj (x)+ J2 x kd(Uxk)(x) = 0. (60) 

j = l k=l+cr io + 1 

Put lo\ = S/ijdxj and lo 2 = XAfcdxfc- Since d commutes with the Lie derivative, we 
may rewrite (|60p as u)i(x) + fu^2(x) = 0. In particular, for any C fc -vector field X 
in Aj _2, we get as UJ\(X) = that fuU> 2 (X)(x) — 0. Now, by virtue of the formula 

U {lo 2 (X)) = Uu 2 (X)+u 2 ([U,X}), (61) 

we obtain since lo 2 {X) = that ^([/o, X])(x) — 0, that is, uj 2 annihilates Ai _i 
at x. But dxi(ai), ■ ■ ■ , dxer io+ i (x) are a basis of the orthogonal space to Aj _i(5) 
by the induction hypothesis, whereas uj 2 (x) is a linear combination of the dxfc(x) 
for i7i +i < k < <7i . Therefore, since we know by the induction hypothesis that 
the dx^ are point-wise independent for 1 < £ < <Ji Q , we get that the A& are zero 
and then the fj,j are also zero by (|60[) . This proves the claim. Next, recall that 
Xi,...,Xo-i are nrs t integrals of Ai _2, thus a fortiori of Aj _3. For X a C k - 
vector field in the latter we deduce from (|61[) . where lo 2 is replaced by dx^ with 
1 + <jj 0+1 < I < o~i , that Xi+<r i0 , ■ ■ ■ ,Xa io +s io are also first integrals of A io _ 3 . In 
case a io + s io < cr io _r, pick X«r <0 +«, +i, ■ ■ • >X<r 4o _i so that X£ for 1 < £ < cr io -i is 
a complete set of independent integrals of Ai _3. If io = 2 we are done, otherwise 
define X<r io _i+j = .fuXa ia +j for 1 < j < Si _i in order to complete the induction 
step. □ 

Proof of Theorems \5.7\ and \5.8\ The two proofs run parallel to each other. 

We first show necessity, assuming that k = 00 for analyticity does not appear in 
the conclusions. Assume local (quasi) smooth linearizability, cf. Definitions 1 5 . 1 1 and 
13.91 Without loss of generality, we assume that f2 = X x U where X and U are open 
neighborhoods of x and u in M n and M m respectively. Let \ : X x U — > 0' C M n+m 
be as in (fl"3|k recall that xi is a smooth diffeomorphism A" — > \i(X). We may also 
assume, after composing x with a linear invertible map, that the pair (A, B) is in 
canonical form (|40p - |lT|) . but we still write A,B rather than A Cl B c . Denote by 
Bq, . . . , B m the columns of B and define the vector fields bo, . . . , b m on M n by 

bi(z) = Bi , 1 < i < m, b (z) = Az + Bu (62) 

and the distributions Aj by 

Aq(z) = Span K {6i(z), . . . , b m {z)} = RanS A i+ i = A, + [bo, Aj] , \<i<m. 

(63) 



From (|42|) . we have 
dxi 

— (x)f(x,u) = bo(XiW) + -8 (XkOe, - XiOj w)) • (64) 

Since x is a triangular homcomorphism, xu(x,w) — xk( :z; ,m) covers an open neigh- 
borhood of in M m when w ranges around u in M m . Thus, in view of (JMJ), C x , u 

defined by (ji9^) contains an open set in (^^r(x)J RanS, and by double inclusion 

(to, 



D(x,u) = -^i(a;) RanB. 
\ox J 

This proves point [1] and also proves that the distribution Ao in point [3] is the pull- 
back of A by the diffeomorphism xi, *-e. (xi)* ^0 = A . Since also implies 
(Xi)* fa — °o, w e have (xi)„ Aj = Aj for all i. This gives point [3] because it is 
obviously true with Aj instead of Aj , and integrability and ranks are preserved by 
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conjugation with the smooth diffcomorphism xi- hi the case of smooth linearizabil- 
ity, point [2] is easily obtained by differentiating (|64|) with respect to u and using 
invertibility of dxs/9u(x, u). 

To conclude the proof of necessity, let us prove point in the case of quasi- 
smooth linearizability. Let 

M = { (x,y)eXxM n ; ^-(x)y - A X i(x) e RanB }. 

ox 

This is a smooth embedded sub-manifold of X x IR n of dimension n + T\ , where 
r\ = RankB < m. If we define F as in 155]) , it is clear from that 

Now, take some (m - ri) x m matrix C whose rows complement r\ independent 
rows of B into a basis of M m . Pick matrices i?i and E 2 of appropriate sizes such 
that 

Ei B + Ei C — I m . 

By g2]) we get 



£1 



9Yj 

— (x)/(x,u) - Axi(x) 



+ E 2 C X n(x,u) = xtl(x,u) 



(65) 



Dehne 

V> : X x W -► M x JR m ~ ri 

by the formula: 

ip(x, u) = (x, /(x, u), Cxn(a;, u))- 
From (|65p , this mapping has an inverse given by 
: ip(X xU) -> A'xW 



(x,y,z) 



— - A (a 



+ £ 2 z 



so that "0 defines a homeomorphism from X x U onto its image which is open in 
M. x lR m ~ ri by invariance of the domain. Let O be a neighborhood of (x, /(x, u)) in 
.M and 5 an open ball centered at C%n(x, u) in lR m ~ ri such that x <S c tp(XxU), 
and take W = V> _1 ( x 5 )- Thcn F : W -> = O is a C° fibration with fiber 

5 and trivializing homeomorphism r/> : VV — > x S. Since S is homeomorphic to 
M m - r \ condition W\ follows. 



We turn to sufficiency. Points HI [31 and either [2] or [2] imply, for all x € X, 

A (x) = Spaa J! {/(j; ) w)-/(i,ii),(u,aj)eWxW}. (66) 

Indeed the right-hand side always contains D(x, u) because it contains all the dif- 
ferences f(x, w n ) — f(x, u) in (Pf§|) . and point [T] implies the reverse inclusion because 
f(x,w) — f(x,u) can be computed as the integral on the segment [u,w] cWofa 
function that, thanks to Proposition l5.6[ belongs constantly to Ao(x). 

From (j6"6"|) . the distribution Ao is of class C k . Considering point [31 we may 
apply Lemma 16.11 We thus obtain some, with fj, Sj and er^ the integers defined 
by and some C fc coordinates Xi, • • • , Xn on a neighborhood of x possibly 
smaller than X (but that we continue to denote by X), i.e. a diffeomorphism 
Xi '• X — > Xi(^O) with xi = (xij ■ ■ ■ 1 X"), meeting the conclusions of Lemma IfTTl In 
particular, xi> ■ ■ ■ > Xn-ri ar e first integrals of the distribution Ao, and from (f6"6")> , 
this implies that dxi/dx(x) f(x, u) does not depend on it, and is there fore equal 
to its value for u = u : 



-^■(x)f(x, u) = faXi (x), 1 < i < n - ri . 



(67) 
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For larger i, the left-hand side depends on x and u : define \ : X x U —> M mi by 

X(x,u) = ( dXn d ^ +1 (x)f(x,u) , ... , ^(x)f(x,u) ) . (68) 

Then, defining coordinates z\,...,z n by z = xi( x )- The equations of system (0]) 
are as follows (the first line gives the derivatives of the n — r\ first coordinates and 
the second line the last ri ones) : 

z*, +1+J = z ai+j , ^ 2<i<p-l,l<j<Si, , gg . 

If point[2]is satisfied, the rank of the map (a;, u) i— > (xi(aO: §^jf( x > u )) ^ s constant 
and thus, according to (f6"6")) . it is equal to ti + 7*1, r% being the rank of Ao. From 
(|67[) . the map (x,u) 1— > (xi(^), A(x, w)) has the same constant rank n + ri. Hence 
there exists 4> : X x W — » M m ~ ri such that 

h-» A(a;,u), <j)(x,u)) (70) 

is a diffeomorphism of class C fe . Obviously, defining xi by xi^ M ) = (A(a;, u), 0(a;, u)) 
yields a C fe diffeomorphism \ that conjugates (01 to a linear controllable system 
z = Az + Bu. This proves sufficiency in Theorem 15.71 

If point [2] is satisfied instead, let V : W -> F(W) X K"~ ri be the "trivializ- 
ing" homeomorphism. Recall that, with 7r : F(W) x K"~ ri — > F(W) the nat- 
ural projection, one has 7r o -0 = F; call : W — > M n ~ ri the map such that 
ip = F X <f> Composing F with (x,£) 1— > (xi( x )j one S e1;s that (x, u) i— > 

x(x,it) = (xi(x), A(x, it), u)) is a homeomorphism. It clearly conjugates ([!]) 
to a linear controllable system i = + Bu. This proves sufficiency in Theo- 
rem EH □ 

6.2. Proof of Theorem I5.21 This theorem for k — uj is consequence of this 
theorem for k = 00 and of Corollarv l5.9l Hence we only have to prove it for k = 00, 
i.e. we assume that / is infinitely differentiable and we prove that topological 
linearizability implies quasi- C 00 linearizability. 

Without loss of generality, we suppose that (x,u) — (0,0). Assume there exists 
a homeomorphism x from a neighborhood of the origin in M n+m to an open subset 
of M n+m that conjugates system ^ to the linear controllable system 

z = Az + Bv (71) 

with z £ IR n and v € IR ,n . Composing x with a linear invertible map allows us to 
suppose that the pair (A, B) is in canonical form ([4T)|) -([4"T ]) . i.e. that (jTTj) can be 
read 

Za-t+k = z CTi _ 1+fc , 2 < i < p, l<k< 8i-i, (72) 

where the integers Sj and Oi were defined in (|38|) and (|39p and where, for notational 
compactness, we have set : 

z n +k = Vk ; (73) 

recall here that sq — m, and notice that s\ < m may well occur as it simply means 
that RankS < m, in which case some of the controls do not appear in the canonical 
form. With the aggregate notation : 

Zj = \ j I, l<i<p-l, £o=| i I , (74) 
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and the matrices J£ defined in (pfTj) . system (j72|) can be rewritten as 



Zp-i 

Zp-2 



_ jSp-2 y 



(75) 



Z 2 = 
Zi = 



Jt 2 1 Z 1 



and is viewed as a control system with state (Z p -i, . . . , Z\) and control Zq. We 
also make the convention, similar to (jTH]) , that 



and we use for the controls the aggregate notation 

/ x n+ i \ ( Ux 



Xn 



(76) 



(77) 



V 



Let us now prove that property Ve below is true for < I < p — 1 . 
Property Vt : there exists a smooth local change of coordinates around in 
M n , say 

(»!,..., x„) h-> . . . ,X 2 ,Xi), 

with X e M ae+1 and X l e M St for < i < I (if i = i/iere are no X { 's beyond X 
whereas if £ = p — 1 there is no X), after which system ([¥]) reads: 



X = F(X,X e ) 

Xi = Fe(X , Xi, Xg-i) 

X% = F 2 {X, Xi, . . . , Xi) 

Xi — Fi(X, Xi, . . . , Xi, Xq) 



(78) 



and such that (|78|) . viewed as a control system with state (X,Xi, . . . ,X±) and con- 
trol Xq, is locally topologically conjugate at (0,0) to system (j75[l via a local home- 
omorphism 

(X, Xi, . . . , Xx,Xq) h-> {Zp-i, . . . , Zq) 
which is, together with its inverse, of the block triangular form : 



(Zp_i,...,Z e+ i) = $(X) 
Zi = &t(X,Xt) 



X = y(Z p -i,...,Z e+ i) 
X e = y £ (Z p „i,...,Zi) 



Zi = ^i(X,X e ,...,Xi) 
Zq = $>o{X,Xi, . . . ,Xi,X ) 



Xi = Vi(Z p -i,...,Zi) 
Xq = ^o(Z p -i, ■ ■ . , Z\, Zq) 



where $i and are, for 1 < i < I, continuously differ entiable with respect to Xi 
and Zi respectively, have an invertible derivative, and satisfy for 1 < i < I the 
relation : 



Fi(X, Xi, . . . , Xi, Xi-i) — Fi(X,X t 



,Xi,0) 



(79) 



&i-i{X, X e ,..., X t ,X^i) - (X, x e 



,Xi,0) 
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furthermore, the partial homeomorphism 

(X,X e ) h-> Z t ) (80) 

locally topologically conjugates, at (0,0) £ M ae+1+Se , the reduced control system 

X = F(X,X t ), (81) 
with state X and input Xg, to the reduced linear control system 

<7 7 s p-i y 

: (82) 

wit state (Zp-i, . . . , Zi + \) and input Zg. 

Indeed, Vq is merely the original assumption on local topological conjugacy of 
systems and (f75|) . where the triangular structure (Tl3|) of the conjugating home- 
omorphism was taken into account; note that, in Vq, (|79p is empty and that the 
reduced system (f5T|) is the original system. Next, supposing that Vt holds for some 
I > 0, we apply Lemmas 16.21 and I6T31 (see below) to the reduced systems (|8Tj) . (JS2J) , 
and to the partial homeomorphism (I80p . with 

d = a i+1 , r = st, s = s i+1 , U = Xt, (xi, ...,Xd) =X, 

Z 1 = {Zp-i, . . . , Z e+2 ), Z 2 = Z e+1 , and V = Z e , 

and then, upon renaming X 2 as Xg + i, f 2 as -F^+i, and choosing X 1 to be the new 
X, we get Vt+i. 

Now, Vp—ii where we specialize (|79|) to i = 1, provides us with a smooth change 
of variables around in M n : 

(xi,...,x n ) i-> (X p -i, . . . ,X 2 ,Xi) 

with Xi € such that, in the new coordinates, system (jlj reads 

Xp-i — Fp_i{Xp_\,Xp-2) 
Xp-2 = Fp-2(Xp-i,Xp-2)Xp-a) 

: (83) 

X2 = F2(X p -i, Xi) 

Xi = Fi(X p _i, . . . , Xi, Xo), 

and also such that the local homeomorphism $ that topologically conjugates system 
(|8"3"|) to system ((75)) at (0, 0) is, together with its inverse of the triangular form : 

Zp-X = $ p _i(X p _!) X p _x = ^_i(Z p _i) 

= < J ) p-2(Xp_i, X p _2) X p _2 = ^p-SA^p-l; Zp-2) 

: : (84) 

Zi = Xx = ^(Zp-i,...,^) 

■Zo = ^>o(X p _i, . . . , Xi, Xo) Xo = if>o(Zp-i, . . . , Zi, Zq), 

where the following three properties hold : 

(1) Each and ^>k for fc > 1 is continuously differentiable with respect to 
Xfc and Zk respectively; in particular, d&k/dXk is invertible throughout 
the considered neighborhood. 

dFk 

(2) For k > 2, Rank—— (0, . . . , 0) = s/- , i.e. this rank is maximum, equal 

iyx fc _i 

to the number of rows. 
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(3) F\ satisfies 

Fi(X p -\, . . . , Xx,X ) = F 1 (X p - 1 ,...,X 1 ,0) (85) 

MX P -i, ...,X U X )- $ (X P -i, ■ ■ ■ , Xi,0) 

From the maximum rank assumption on dF p -i/dX p -2, it is possible to define 
Yp-2 whose first s p _i entries are those of F p —i(X p —i, X p _2) and whose remaining 
s p _2 — s p _i entries are suitable components of X p _2, in such a way that 

(Xp-i, . . . ,Xi) 1— > (X p ^i, Y p -2, X p -3 . . . , Xi) 

is a local smooth change of coordinates around in M n . After performing this 
change of coordinates and setting Y p -\ = X p -\ for notational homogeneity, system 
([531) reads 

\r T s p-1 v 

*p-l — J Jp-2 Y p-2 

Y p -2 = F p -2{Yp-l, Y p -2, Xp-z) 

X2 = F2 (5^,-1, Y p -2, X p - 3 , . . . , Xi) 
X\ = Fi(Y p -i,Y p -2, X p - 3 , . . . ,Xi,Xq) 

where the F's enjoy the same properties than the F's, in particular the maximality 
of Rank dFk/dXk- i(0, . . . , 0) for p — 2 > k > 2. One may iterate this procedure, 
limited only by the fact that the maximum rank property mentioned above only 
holds for k > 2 but not necessarily for k = 1. Altogether, this yields a smooth local 
change of coordinates around in M n : 

{Xp-\, ... ,Xi) ~ 

after which system (|8"3"|) is of the form 

Y p -i = Js P p -l Y p -2 

. 1 (86) 
Y2 = JgY! 

Y\ = Fi(Y p -i, , . . . ,Yi,Xq) , 

where we abuse the notation F\ for simplicity because, although it needs not be 
the same as in (j83|) . this new F\ enjoys the same property (|85|) for some suitably 
redefined $1 and <&o. Now, we may rewrite (|8"5)) as 

F 1 (Y p _ 1 ,,...,Y 1 ,X ) = J%H(Y p - 1 ,,...,Y 1 ,X ) (87) 

where H, in the aggregate notation Y = {Y p -\. , . . . , Y±), is defined by 

h(y,x ) = ( Fl( ^' 0) ) + (^ ( yrl /m s J(<i>o(r,A )-$ (y,o)). 

Since <I> has the triangular structure displayed in |84|) . the map Xq 1— > &o(Y, Xq) is 
injective for fixed Y = (Yp-i , . . . , Yj.) in the neighborhood of where it is defined in 
M m . Consequently, (Y,Xq) i— > (Y, H(Y 1 Xq)) is also injective in the neighborhood 
of where it is defined in M n+m ; since it is continuous, it is a local homeomorphism 
of M n+m at (0,0) by invariance of the domain, and then (|86|) . |87|) make it clear 
that system (|83[) is locally quasi-smoothly linearizable at this point. 

Since is smoothly conjugate to the original system ([?]), this proves local 
quasi-smooth linearizability of the latter hence the theorem. 
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Two lemmas. The following two lemmas are applied recursively in the above 
proof of Theorem [Ol to obtain the forms (|55]l. (JTSJ), and (JHH). Although these 
lemmas team up into a single result in the above-mentioned proof, they have been 
stated here separately for the sake of clarity. 

We will consider two control systems with state in lR d and control in M r . Ex- 
panded in coordinates, the first system reads 

x\ = fi(xi, . . . ,Xd,Xd+i, ■ ■ ■ ,x d+r ) 



Xd = fd(%l, ■ ■ ■ ,Xd,Xd+l, ■ ■ ■ ,X d +r) , 

with state variable (x\, . . . , Xd) and control variable {xd+i, ■ ■ ■ , x d + r ) € lR r , the 
functions /i , • ■ • , fd being smooth M d+r — > M. The second system has state vari- 
able (z±, . . . , Zd) and control variable (zd+i, ■ ■ ■ , Zd+r) € lR r , and it assumes the 
special form : 

zi = gi(zi, ... ,z d ) 

Zd-s = 9d-s{z\, ■ ■ ■ , Z d ) 
Zd-s+1 = Zd+1 



Zd — Zd+s , 

where < s < d and s < r while gi, - ■ ■ , gd-s are again smooth lR d — > St. Nothing 
prevents us here from having s < r, in which case some of the controls do not enter 
the equation. It will be convenient to use the aggregate notations 

X = (X\, . . . , X d ) , U = (X d +1, X d +r) , 

Z = (zi, ...,Zd), V = {Zd+l, ■ ■ - ,Zd+r) , 

and to further split Z into (Z 1 , Z 2 ) with 

Z 1 = {zi, . . . ,Zd- s ) , Z 2 = [zds+i, ■ ■ ■ ,z d ) , (90) 
so as to write ({55} in the form 

X = f(X,U) (91) 

and ((HS]) as 

Z 1 = g\Z\Z 2 ) 

Z 2 = J°V, 

with J* the s x r matrix, defined in (f^Tj) . that selects the first s entries of a vector. 

Lemma 6.2. Let d, r and s be strictly positive integers with s < d and s < r. 
Suppose, for some e > 0, that 

if : (-£, e) d+r -> R d+r 

is a homeomorphism onto its image, with inverse ip, that conjugates system (|91[) to 
system (|92p . Then, there exists < e' < e and a smooth local change of coordinates 
around S M d : 

0: (-e',e') d -> 0((-e', s') d ) C (-e, e) d 

^/la^ jixes f/ie origin and is such that, in the new coordinates X = 6~ 1 {X), both 
the system (|91[) and the conjugating homeomorphism tp — (p o (9 X id) assume 
a block triangular structure with respect to the partition X = (X 1 ^ 2 ), where 

X 1 = (x\, . . . ,Xd- s ) and X 2 = (xd-s+i, ■ ■ ■ ,Xd); that is to say, on {—e',e') d+r , we 
have that 



(92) 



ON LOCAL LINEARIZATION OF CONTROL SYSTEMS 



31 



system ([88)1 reads 



x.1 _ _ _ 

?a = {, 1(Xl '^ 2) (93) 

• On i/ieir respective domains of definition, the homeomorphism ip and its 
inverse ip = (O^ 1 x id) o ip read : 

z 1 = ^(x 1 ) x 1 = mz 1 ) 

Z 2 = P 2 (X\X 2 ) X 2 = ih(Z\Z 2 ) (94) 

v = ^(x\x 2 ,u) u = mz\z 2 ,v). 

Lemma 6.3. Let 

ip: {-e',e') d+r M d+r 
be a homeomorphism onto its image, having the block triangular structure displayed 
in (19411 . and assume that it conjugates the smooth system (193|) to the smooth system 
(|9"2")l . Necessarily then, ip has the following properties : 

(1) The map ip 2 is continuously differ entiable with respect to its second argu- 

dip 2 

ment X 2 , and — ^(0,0) is invertible. 
OX 2 

(2) On some neighborhood of G M d+r included in (—e / ,s') d+r , one has : 
f 2 (X\X 2 ,U) = (95) 

f 2 (X\X 2 ,0) + ^(X\X 2 )^ J* (f(X\X\U)-0*(X\X*,O)) 

(3) On some neighborhood of G M d included in (~e',e') d , the partial home- 
omorphism 

(X\X 2 ) ^ (^ 1 ),^ 1 ,X J )) (96) 
conjugates the control system 

X^ = J\X\X 2 ), (97) 
with state X 1 and control X 2 , to the control system 

Z l =g\Z\Z 2 ) (98) 
with state Z 1 and input Z 2 . 
Note that ([9T| and (|9"8)l are reduced systems from ([9"3")l and 



Proof of Lemma w. 2\ Since the homeomorphism <p conjugates (|91|) to (|92|) . we know, 
by Proposition 13.61 that p and ip split component-wise into : 

z = MX) x = mz) (m} 

v = pe(x,u) u = Mz,v) . iy9J 

Consider the map / : (— e,e) d+r — > lR d given in ([9"T)l , and let us define g : 
p{(— s, e) d+r ) — > lR d analogously from (JUJ), namely g is the concatenated map 
whose first d — s components are given by g 1 {Z) and whose last s components are 
given by J^V . Define two families of continuous vector fields T 1 and Q', on {—e, e) d 
and <pi((— £, s) d ) respectively, by the following formulas (compare (|142[1 ) : 

J~' = { ^/ Ql ,a 2 ; ai, o;2 feedbacks on (—£, e) d+r } , (100) 

Q' = {$901,02 i0i,02 feedbacks on ip[(—£,e) d+r ) } . (101) 

Applying Proposition ^. 131 twice, first to \ — f an d then to \ — ip, we see that each 
integral curve of a vector field in T' is mapped by ip\ to some integral curve of a 
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vector field in Q' and vice-versa upon replacing ipi by tpi . This shows in particular 
that uniqueness of solutions to the Cauchy problem associated to vector fields is 
preserved, i.e. if we define the families of vector fields (compare (1143j) ) : 

T" = { Y e T' , Y has a flow } , (102) 
G" = {Y e Q' , Y has a flow} , (103) 

we also have that each integral curve of a vector field in T" is mapped by (pi to an 
integral curve of a vector field in g" and vice-versa upon replacing ip\ by ifa. By 
concatenation, using Proposition IB. 51 it follows that 

for any X G (— e,e) d , ip\ defines a homeomorphism, 
for the orbit topologies, from the orbit of T" through X \ (104) 
onto the orbit of g" through (pi(X), 



where the orbit topology as described in Proposition IB. 51 (by definition the re- 
striction of ipi is bi-continuous for the topologies induced by the ambient space; 
bi-continuity for the orbit topologies requires the description of these topologies as 
given in Proposition IB . 5( ) . 

Now, the vector fields Sg/3 1 _^ 2 appearing in p01[) inherit from the structure of g, 
displayed in (|92[) . the following particular form : 



%i,/3 2 (Z) 



(105) 



/ o \ 



V PiAz) - M z ) ) 

where ■ ■ ■ , /?i, s designate, for i = 1, 2, the first s component of the feedback Pi. 
This will allow for us to describe explicitly the orbits of g" , namely : 

the orbit of g" through Zq = (ci, . . . , Cd) \ 

is the connected component containing Zq of the set > (106) 

{Z e (fi ((-£, e) d ) , zi = cx,..., z d ^ s = c d _ s }. J 

Indeed, the orbit in question is contained in this set, because it is connected, and 
because all the vector fields in g" have their first d — s components equal to zero 
by (TTM)) . 

To prove the reverse inclusion, it is enough to show that the orbit of g" through 
Zq, denoted hereafter by Ogi^ Zi „ contains all the points sufficiently close to Z 
having the same first d — s coordinates as Zq. Indeed, since Zq was arbitrary, this 
will imply that the connected component defined by (|106|) splits into a disjoint 
union of open orbits hence consists of a single one by connectedness. That is to 
say, putting Zq = (Zq, Zq) according to ([50)1 . 11061 will follow from the existence of 
a p > such that 

{Zl} x B{Z 2 Q,p) =B(ZQ,p)nO g „, Zo . (107) 

Now, it follows from Remark IB. 31 that, for sufficiently small p, each connected 
component of B(Zq,p) n Og».z is an embedded sub-manifold of B(Zq,p). Then, 
the connected component of B(Zq,p) n Cg",z containing Zq is, by inclusion, an 
embedded sub-manifold of the linear manifold {Zq} x B(Zq, p). In particular, since 
no strict sub-manifold can be densely embedded in a given manifold, we see that 
(|107p will hold is only we can prove that 

The connected component containing Zq of B(Zq, p) n Og",z (ir\Q\ 
is dense in {Zq} x B(Zq,p) for the Euclidean topology. 
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To prove (|108[) . pick Vq such that (Zq,Vq) € f((— £, s) d+r ) and observe, since 
the latter is an open set, that shrinking p further, if necessary, allows us to as- 
sume B(Zo,p) x B(Vo,p) C (/?((— £, e) d+r ) . FKe claim that any continuous map 
B(Zq, p) — > -B(Vo, p) extends to a feedback on (p((— e, e) d+r ) . Indeed, in view of the 
one-to-one correspondence (3 — > ?/>■/? between feedbacks on £, e) d+r ) and feed- 
backs on (— e,e) d+r (cf the discussion leading to l[2"5]l - ([2"I]0 . it is enough to prove 
that every continuous map ipi(B(Z , p)) — + (— e,e) r extends to a continuous map 
(— e,e) d — > (— e,£) r , and this in turn follows from the Tietze extension theorem 
since ifaCB^Zo, p)J is closed in (— e,e) d and since (— e,e) r is a poly-interval. 27ms 
proves the claim. 

From the claim, it follows that the restriction to B(Zq, p) of the M s -valued vector 
field J*(@i(Z) — f32(Z)), accounting for the lower half of the right-hand side in (|105l) . 
can be assigned arbitrarily, by choosing adequately the feedbacks (5\ and /?2 , among 
continuous vector fields B(Z$,p) — > -8(0, p) (take /3a to extend the constant map 
Vo on B(Zo,p)). Of course, the corresponding vector field Sgp ly f3 2 in (1105|) belongs 
to Q' but not necessarily to Q" since continuous vector fields need not have a flow. 
However, since Sg^^ has a flow at least when (3± and /?2 are smooth, we deduce 
from Proposition 13.41 that the restriction to B(Zo,p) of the vector fields in Q" are 
of the form {0} x Y, where Y ranges over a uniformly dense subset T of all -R s - 
valued continuous maps B(Zo,p) — > B(0,p). Now, every point in B([Zq,p) can 
be attained from Zq upon integrating, within B(Z$,p), a constant vector field of 
arbitrary small norm. By Lemma [Q applied with U = B(Z$,p) and K = {Zq}, 
the corresponding trajectory can be approximated uniformly by integral curves that 
remain in B(Zq, p) of vector fields in T. Therefore, every point in {z^} x B(Z$, p) 
is the limit of endpoints of integral curves of Q" that remain in {zq} x B(Zq,p), 
which proves QlOSp and thus (1106p . In particular, the orbits of Q" are embedded 
sub-manifolds in <pi((— e,e) d ). 

Next, we turn to the orbits of T" , and we designate by Of» tP the orbit of T" in 
] — e, e[ d through the point p. On the one hand, Proposition IB . 51 and Theorem lB.2l 
show that Ojrn p is a smooth immersed sub-manifold of ] — e,e[ d . On the other 
hand, by (|104p . this immersed sub-manifold is sent homcomorphically by (pi, both 
for the orbit topology and the ambient topology, onto ®g",<pj(p) which is a smooth 
embedded s-dimensional sub-manifold of <pi((— as we saw from (|106[) . This 
entails that all orbits of T" in ] — e, e[ d are embedded sub- manifolds of dimension s. 
Consequently, still from Proposition IB. 51 and Theorem IB. 21 there are coordinates 
. . . , £d) defined on an open neighborhood Wo of the origin in ] — e, e[ d — this 
neighborhood may be assumed to be of the form {(£i, . . . , < e '} — sucn 

that, in these coordinates, 

w n cv,,„ = {(a,... ) ^),with(e 5+ i,...,Crf)eT}, 

with T a subset of ]— e', e'{ d ~ s containing (0, . . . , 0), the tangent space to WoHCV",o 
at each of its points being spanned by d/d^i, . . . , d/d^ s , while at any point p G Wo 
the vector fields <9/<9£i, . . . , d/d^ s belong to the tangent space of 0^n p , But since 
we saw that all orbits are smooth sub-manifolds of dimension s, these vector fields 
actually span the tangent space to the orbit at every point. Hence all the vector 
fields Sf ai . a2 in T" have their last d — s components equal to zero on Wo in the 
£ coordinates, and this holds in particular when a±, oli range over all constant 
feedbacks (— e,e) d — > (— s,e) r . This implies, by the very definition of Sf aiiCC2 , that 
(£s+i; ■ ■ ■ ,Cd) — as computed from (191|) upon performing the change of variable 
X ^ . . . , £d) — does not depend on the control variable U. Choose for X the 
£ coordinates arranged in reverse order, and let / be the analog of / in the new 
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coordinates (X, U). Then the first d — s components of / do not depend on U so 
that holds. Moreover, if <p denotes the new homeomorphism that conjugates 
to (152")) over (— e,e) d+r , ip((—e,e) d+r ), and if ip denotes its inverse, it follows 
from (|104|) and the above characterization of the orbits that <p.\ maps the sets 
where Si, ... , id- s are constant to those where z\, ■ ■ ■ , Zd- S are constant, thus the 
functions tpi, . . . , <f>d-s and tpi, . . . , ipd-s depend only on their d — s first arguments 
whence (l94l) follows. □ 



Proof of Lemma \6.3[ We use again the concatenated notation (pi = (ip 1 ,/^ 2 ), ipj — 
ip 2 ), these partial homeomorphisms being inverse of each other. Let (Zq, Vq) G 
p((-e', e') d+r ) and e" be so small that the product neighborhood (Z , V )+(-e", e") d+r 
lies entirely within <p((-e', e') d+r ). The restriction to (Z Q ,V ) + {-e",e") d+r of -0 
conjugates (|52")l to Consequently, for any V G (— e",e") r , we may apply 

Proposition 13. 131 to this restriction and to the constant feedbacks ot\(Z) = Vq + V 
and oli{Z) — Vq; this yields that ipi, given by 

(Z\Z 2 ) ~ (x\x 2 ) = (^(z^iz^z 2 )), 

maps every solution of 

Z 1 = , Z 2 = J°V (109) 
that remains in Zq + (— s", e") to a solution of 



x 1 = o , x 2 = f 2 {X\ X\ ^{^{X%^{X\ X 2 J,V + V)) 
-f 2 (X\X 2 ,^&(X^^(X\X 2 ),V )) 



(110) 



that remains in ipi(Zo + (—s", e") d ), and vice versa upon applying Proposition 13.131 
in the other direction. 

Integrating (|109p explicitly with initial condition Z(Q) = Zo, we get that 



t 



solves (|110l) for sufficiently small t, hence ip 2 {Z 1 1 Z 2 ~) is differentiable at Zq with 
respect to its second argument in the direction J£V, with directional derivative 

^(z^z 2 )j:,v = J 2 $\zl)^{zlz 2 )^\zlzlv + v)) 

-J 2 ^\zI)^ 2 {zIz 2 )^{zIzIVq)) . (in) 

In particular, since Zq can be any member of £>i((— e', e') d ) while J^V can be 
assigned arbitrarily in (— e", e") s , we conclude that dtp 2 /dZ 2 (Z 1 , Z 2 ) exists and is 
continuous since this holds for the partial derivatives. Next we prove that dip 2 /dZ 2 
is invertible at every point by showing that its kernel reduces to zero. In fact, if 
the left-hand side of (lllip vanishes, so does the right-hand side which is also the 
value of the right-hand side of (|110p for X = %pj(Zo). Therefore the constant map 
1 1 — ► tpiiZo) is a solution to (|110|) over a suitable time interval, and by conjugation 
the constant map t i— > Zq is a solution to (|109p over that time interval which 
clearly entails J^V — 0, as desired. Now, since dip 2 /dZ 2 is invertible at every 
(Z^Z 2 ) G £>i((— e', e') d ), the triangular structure of and the inverse function 
theorem together imply that 

||(X\X 2 ) = (^^H^)^{X\X 2 ))^ (112) 

continuously exists and is invertible for (X 1 ^ 2 ) G (— e',e') d . This proves point [TJ 
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Let us turn to point [5] Select an open neighborhood W of having compact 
closure in (— e',e') d , so there is r\ > such that tp(X,0) + (—r],ri) d+r is included 
in £>((-£', e') d+r ) whenever X G W. If V € (-r),ri) r , we can apply Ijllljl to 
(Z , Vb) = tp(X, 0) with X G W, and we obtain in view of (|112p : 

( 9 ^-{X l ,X 2 )) J°V = -/ 2 (X\1 2 ,0) (113) 



Set 



+ / 2 (x 1 ,x 2 ,^ 3 (^ 1 (x 1 ),^(x 1 ,x 2 ),^(x 1 ,x 2 ,o)+y)) 



U^&iX^lfiX^X^^X^O) + V) (114) 

and observe that (X,V) i— » (X, [/) = ip((p(X,0) + (0,V)) defines a continuous 
map h : W x (—77,77)'' — * (— e', e') d+r , such that /i(0) = 0, which is injective. By 
invariance of the domain, h is a homcomorphism onto some open neighborhood of 
0, say TV C (-s', e') d+r - For (X, U) G TV, (fTT^|) can be inverted as 

F=^ 3 (X,C/)-^ 3 (X,0), (115) 

and substituting ([TH]) and (fTT5|) in (fTT^|> yields ([35]) . 

Finally we prove point [21 keeping in mind the previous definitions and properties 
of h, W, 77 and TV. For X = (X^X 2 ) G (-e',e') d , define V(X) e M s x {0} C iR r 
by the formula : 

J r s F(X) = ^£(X 1 ,X 2 )(7 2 (0,0,0)- 7 2 (X 1 ,X 2 ,0)). (116) 
oX 

Clearly 1/ : (— e', e') d — > is continuous and V(0) = 0, so there exists an open 
neighborhood V C W of in J? d such that V(X) G {-r],r]Y as soon as X G V; 
then, if we set = (X, U(X)) G TV, it follows from (flTO]) . ([ITB]) . and 1^5]) 

that 

f 2 (X\X 2 ,U(X)) = p(0,0,0), leV. (117) 

We will show, using Proposition 13.121 that the restriction of tp% to any relatively 
compact open subset XofV conjugates (|97p and ([55]) over X, tp{X), and this will 
achieve the proof. To this effect, let C to be the collection of all piecewise affine 
maps M — > iR s with constant slope / 2 (0, 0, 0) (c/the discussion before Proposition 
I3.12p and note that, for any open set O C M s and any compact interval J C M, the 
restriction of C to J contains, in its uniform closure, the set all piecewise continuous 
maps J — > O. Now, consider a solution 7 : / — > V of the control system : 

X = /^T^T) (118) 

with state X 1 and control T; hereafter, Vi C M d ~ s and Vn C M s will indicate 
the projections of V onto the first d — s and the last s components respectively, 
and similarly for any other open set in M d . Assume that the control function 
7k : I — > Vn is the restriction to / of some member of C. By definition, if a, b 
are the endpoints of I (that may belong to I or not), there are time instants 
a = to < ti < ■ ■ ■ < tjv = b, and vectors £1, . . . , |jv G M s such that, for 1 < j < N, 
one has 

t j . 1 <t<t j 7E (i) 1/ 2 (0,0,0), (119) 

while at the points tj themselves 71 is either right or left continuous when 1 < 
j < N. We claim that <pi("/(t)) is a solution that remains in £>i(V) of the control 
system : 

Z 1 = g\Z\Y) (120) 
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with state Z 1 and control V. In fact, since 71 is continuous by definition of a solution, 
so is ^(71) and therefore, as ^(^(t)) lies in <pi(V) for all t £ I by construction, it 
is enough to check that 

^( 7 i(T 2 )) - ^( 7 i(T!))= / T V(^(7iW)^ 2 (7iW,7kW)) dt (121) 

whenever tj-i < T\ < T2 < tj for some j > 1. However, the restriction of j(t) to 
(tj—i, tj) is a solution that remains in V of the differential equation : 

7i = / 1 (7i,7k) 
7i = / 2 (0,0,0), 

hence (7(f), I7(7(i)) is, by (JTT7J) , a solution of (|93|) that remains in AT, and therefore 
(|12ip follows from the triangular structure (|94|) of and the fact that it conjugates 
system (|93p to system (|92p . T/ijs proves the claim. 

In the other direction, we observe since it is included in W that V has com- 
pact closure in (— e',e') d , and therefore that <fii(V) in turn has compact closure in 
cpi ((-£', e') d ). Pick i > such that ^(V) X (-r,',r,') r C £') d+ ''), and lc t 

C denote the collection of all piecewise smooth maps JR — > JR S whose derivative is 
strictly bounded by 7/ component- wise. The restriction of C to any compact real 
interval J is uniformly dense in the set all piecewise continuous maps J — > 0, for 
any open set C iR s . Clearly, any solution 7' : 7 — > <£>i(V) of system (I120j) . whose 
control function 7^ : 7 — > (^i(V)J is the restriction to 7 of some member of C , 
satisfies the differential equation 

i'i = gH^-A) 
7 ; = J r s (rf7KM,o) 

on every interval where it is smooth. By the very definition of rj' and C , it follows 
that (7'(i), (d-y^(t)/dt,0)) is, on such intervals, a solution to f!)2"|) that remains in 
£>((— e', e')) rf+r and, since ^ conjugates system to system we argue as 

before to the effect that ipi(-f') is a solution to system (111 8[) that remains in V. 
Appealing to Proposition 13.121 we conclude that £>i conjugates system (I118[) to 
system (|120j) on relatively compact open subsets of V, as desired. □ 

Appendix A. Four lemmas on ODEs 

Throughout this section, wc lct U be an open subset of M d . We say that a 
continuous vector field X : U — > M d has a flow if the Cauchy problem x(t) = 
X(x(t)) with initial condition x(0) = Xq has a unique solution, defined for t £ 
(— e,e) with e = e(xo) > 0. The flow of X at time t is denoted by X t , in other 
words we have with the preceding notations that X t (xo) — x(t). It is easy to see 
that the domain of definition of (t, x) 1— > X(t, x) is open in M x U. 

Lemma A.l. If X :U — * _ZR d is a continuous vector field that has a flow, the map 
{t,x) 1 — ► Xt(a;) is continuous on the open subset of M x U where it is defined. 

Proof. This is an easy consequence of the Ascoli-Arzela theorem, and actually a 
special case of [3 chap. V, Theorem 2.1]. □ 

Lemma A. 2. Assume that the sequence of continuous vector fields X k : U — > IR d 
converges to X , uniformly on compact subsets ofU, and that all the X k as well as 
X itself have a flow. Suppose that X t {x) is defined for all (t,x) £ [0,T] x K with 
T > and K cW compact. Then X k {x) is also defined on [0, T] x K for k large 
enough, and the sequence of mappings (t,x) 1— > X k {x) converges to (t,x) 1— > X t (x), 
uniformly on [0, T] x 7\. 
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Proof. By assumption, 

K 1 = {X t {x); (t,x)e [0,T]xK} 

is a well-defined subset of U that contains if, and it is compact by Lemma I A. II Let 
ifo be another compact subset of U whose interior contains ifi, and put d[Kx,H \ 
Kq) = r] > where d(E\,E2) indicates the distance between two sets E\, E%. 
From the hypothesis there is M > such that \\X k \\ < M on Kq for all k, hence 
the maximal solution to x(i) = X k (x{t)) with initial condition x(0) = xq e K 
remains in Kq as long as i < rj/2M. Consequently the flow (t, x) i— > AT t fe (:z;) is 
defined on [0, rj/2M] x if for all k, with values in Kq. We claim that it is a 
bounded cquicontinuous sequence of functions there. Boundedness is clear since 
these functions are ifo-valued, so we must show that, to every (t, a;) € [0, rj/2M] x if 
and every e > 0, there is a > such that ||X fc (£', x') — X k (t,x)\\ < e for all k as 
soon as \t — t'\ + — < a. By the mean- value theorem and the uniform 
majorization ^X k (X k (x))\\ < M, it is sufficient to prove this when t — t'. Arguing 
by contradiction, assume for some subsequence ki and some sequence xi converging 
to a; in if that 

\\X kl (x) - X kl {xi)\\ > e for all I E N. (122) 

Then, by Lemma I A. 11 the index fc; tends to infinity with I. Next consider the 
sequence of maps Fi : [0, r)/2M] — > Kq defined by Fi(t) = X kl (xi). Again, by 
the mean value theorem, it is a bounded equicontinuous family of functions and, 
by the Ascoli-Arzela theorem, it is relatively compact in the topology of uniform 
convergence (compare chap. II, Theorem 3.2]). But if $ : [Q, r\J1M\ — > ifo is 
the uniform limit of some subsequence Fu , and since X 'i converges uniformly to 
X on ifo as j — > oo, taking limits in the relation 

X^ (x h ) = x h + / X k h (X" h (x h )) ds 
Jo 

gives us 

<P{t) =x + [ X{<P{s))ds 
Jo 

so that $(£) = X t (x) since X has a flow. Altogether Fi(t) converges uniformly 
to X t (x) on [0, r]/2M] because this is the only accumulation point, and then (|122p 
becomes absurd. This proves the claim. From the claim it follows, using the Ascoli- 
Arzela theorem again, that the family of functions (t, x) i— > X k (x) is relatively 
compact for the topology of uniform convergence [0, r)/2M] x K — » ifo, and in fact 
it converges to (t,x) i— > X t (x) because, by the same limiting argument as was used 
to prove the claim, every accumulation point §(t,x) must be a solution to 

x) = x + / X(s,$(s,x))ds 
Jo 

hence for fixed x is an integral curve of X with initial condition x. In particular, by 
definition of K u we shall have that d(X^(x), Kx) < r}/2 for all (t, x) G [0, r//2M] x K 
as soon as k is large enough. For such k the flow (t, x) i— > X k (x) will be defined on 
[0, rj/M] x if with values in ifo, and we can repeat the whole argument again to the 
effect that X k (x) converges uniformly to X t (x) there. Proceeding inductively, we 
obtain after [2TM/rj\ + 1 steps at most that (t, x) i— > X k (x) is defined on [0, T] x if 
with values in ifo for k large enough, and converges uniformly to (t,x) <— > X t {x) 
there, as was to be shown. □ 

The next lemma stands analogous to Lemma IA.2I for time-dependent vector 
fields, assuming that the convergence holds boundedly almost everywhere in time. 
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The assumption that the vector fields have a flow is replaced here by a local Lipschitz 
condition that we now comment upon. 

By definition, a time-dependent vector field X : [£i , £2] X IA — > M d is locally 
Lipschitz with respect to the second variable if every (£0,^0) G [ti,ta] x U nas a 
neighborhood there such that \\X(t, x') — X(t, x)\\ < c\\x' — x\\ , for some constant c, 
whenever (£, x) and (£, x') belong to that neighborhood. This of course entails that 
X is bounded on compact subsets of [£1, £2] xW. Next, by the compactness of [£1, £2], 
the local Lipschitz character of X strengthens to the effect that each Xq £ IA has a 
neighborhood J\f XQ such that \\X(t, x 1 ) — X(t, x)\\ < c Xo \\x' — x\\, for some constant 
c Xo , whenever x, x 1 G Af Xo and £ € [£1, £2]. If now JC C Li is compact, we can cover it 
by finitely many J\f XQ k as above and find e > such that x,x' G JC and ||x — x'\\ < s 
is impossible unless x,x' lie in some common Af Xo . Consequently there is > 
such that \\X(t,x') — X(t,x)\\ < cic\\x' — x\\ whenever x, x' G JC and £ G [£i,£2], 
because if ||a; — x'\\ < e we can take c/c > max^ c Xo k , whereas if ||x — x'|| > e it is 
enough to take c/c > 2M/e where M is a bound for ||X|| on [£1, £2] x JC. Finally if 
X(t,x) happens to vanish identically for x outside some compact JC' C U, we can 
choose JC such that 

K! c k c K, c U 

and construct c/c as before except that we also pick e > so small that \\x — x'\\ < e 
is impossible for x G JC' and x' JC. Then it holds that \\X(t,x') — X(t,x)\\ < 
c/c\\x' — x\\ for all x,x' € 14 and all £ G [tijia], that is to say X(t,x) becomes 
globally Lipschitz with respect to x. These remarks will be used in the proof to 
come. 

Lemma A. 3. Let t\ < £2 be two real numbers and X k : [£i,£2] xW-> lR d a se- 
quence of time- dependent vector fields, measurable with respect to t, locally Lipschitz 
continuous with respect to x G IA, and bounded on compact subsets of [£1, £2] x 14 in- 
dependently of k. Let X : [£i,£a] X U — > M d be another time- dependent vector field, 
measurable with respect to t, locally Lipschitz continuous with respect to x G U, 
and assume that, to each compact JC C IA, there is C [£i,£2] of zero measure 
such that, whenever t E/c, the sequence X k (t, x) converqes to X(t,x) as k — > 00, 
uniformly with respect to x G JC. Suppose finally that 7 : [£i,£2] — * U is, for some 
(£o,a;o) G [iijia] xU, a solution to the Cauchy problem 

7 (£) - X(t n (t)) , 7 (£ ) = x . (123) 

Then, for k large enough, there is a unique solution : [£i,£a] to the Cauchy 
problem 

7fc (£) = X k {t, lk (t)) , 7 fc(£o) = xo, (124) 
and the sequence ( 7 fc) converges to 7, uniformly on [£i,£2]- 

Proof. Upon multiplying X k (t, x) and X(t, x) by a smooth function <p(x) which is 
compactly supported IA — * M and identically 1 on a neighborhood of 7 ([£i, £2]); we 
may assume in view of the discussion preceding the lemma that X(t, x) and X k (t, x) 
are defined and bounded [£i,£2] x lR d — > Ft d independently of k, measurable with 
respect to £, and (globally) Lipschitz continuous with respect to x. 

Then, by classical results [23l Proposition C 3.8., Theorem 54], the solution to 
(|124p , say 7^ uniquely exists [£1 , £2] — > M d for each k : 

lk(t)=x + [ X k (s, lk (s))d S , te [£i,£ 2 ]- (125) 



From the boundedness of X k , it is clear that 7^ is an equicontinuous and bounded 
family of functions, hence it is relatively compact in the topology of uniform con- 
vergence on [£i,£2]- All we have to prove then is that every accumulation point 
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of 7^ coincides with 7. Extracting a subsequence if necessary, let us assume that 
7fe converges to some 7, uniformly on [tijta]. Let JC C M d be a compact set con- 
taining 7fc([ti,f2]) for all k; such a set exists by the boundedness of 7^. If we let 
E/c C be the set of zero measure granted by the hypothesis, there exists to 

each s € [ti,fa]\E/c and each e > an integer k s , e such that ||X fc (s, x)—X(s, x)\\ < e 
as soon as x € /C and fc > fc Si£ . In another connection, the Lipschitz character of X 
with respect to the second argument and the uniform convergence of "fk to 7 shows 
that that \\X(s,jk(s)) — X(s,j(s))\\ < e for k large enough. Altogether, by a 2-e 
majorization , we find that 

lim \\X k ( Sr/k (s))-X( S ,%s))\\ =0, 

K — tOO 

that is to say the integrand in the right-hand side of (|125p converges point-wise 
almost everywhere to X(s, 7(s)). Since X k is bounded we can apply the dominated 
convergence theorem and, taking limits on both sides of (|125p as k — > 00, we find 
that 7 is a solution to p23[) whereas the latter is unique. Hence 7 — 7 as desired. □ 

The following averaging lemma for continuous vector fields is less classical than 
in the locally Lipschitz case, where the Cauchy problem has a unique solution. 

Lemma A. 4. Let t\ < fa be real numbers and (X 1 ' i )e e jiy , (X 2,i )g e ]N , be two 
sequences of continuous time- dependent vector fields \pi,fa] X IR d — > lR d , uniformly 
bounded with respect to I, that converge uniformly on compact subsets of [t\ , fa] x M 
to some vector fields X 1 and X 2 respectively. Denoting by L — fa — 1\ the length of 
the time interval, define, for each £ £ IN, the "average" vector field Gg : [^1^2] X 
M d ^M d by : 



(126) 



te[h + iL,t 1 + y$L) => G t {t,x) = X^(t,x) , 
te[fa + ^L,ti + ^L) => G t (t,x) = X 2 ^{t,x) , 

for j E {0, ...,£— 1} and, say, Gi(fa, x) — X 2 ^(fa, x) for definiteness. 
Let "fg : [fa, fa] — > IR be a solution to 

7/ (t) - x = [ Gf(T,7/(r))dT . (127) 

Jt! 

Then the sequence (7^) is compact in C°(\t%, fa], IR ), and every accumulation point 
700 is a solution to 

loo(t)-x = ijf (A 1 (r,7 00 (T))+A 2 (r,7 00 (r)))dT . (128) 

Proof. Let 

M = sup \\X l ^(t,x)\\ . (129) 

From ()126|) - (jl27|) . it is clear that M is a Lipschitz constant for 7^, regardless of I. 
In particular "fi(t) stays in a fixed compact ball B of radius ML, and the family 
(7^) is equicontinuous. From Ascofi-Arzela's theorem this implies compactness of 
the sequence (7^) in the uniform topology on [ii,^]- 
Rewrite (fT2"7|) as 

jl(t) -x = J \Gi{r,-ft(T)) I dr 

X^(T, le (T))+X 2 ' e (T, le (r)) _ X\T, le (T))+X 2 (r, le (r)) 
2 2 
+ rtXi(r, ld r ))+ X 2 (rMr ))dT _ 
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By the uniform convergence of X' 1 ' 1 to X 1 , it will clearly follow that any accumu- 
lation point of (7^) satisfies (|128j) if only we can show that the first integral in 
the right-hand side of (|130p converges to zero as £ — > 00. 
To prove this, we compute, from the definition of Gg : 

tl + ^ £ XM( T , 7< ( T ))-X2,/ (T>7<(T)) ^ ^ 
ti + }L 2 

^+^ L X^(rMr))-X^(r, le (r)) dT 
U + ^L 2 

(A*(t,7*(t)) - A,(t + i, 7£ (r + i))) dr 

with = l^ 1 ^ — X 2,f ). On the compact set [ii,t 2 ] x B, the vector field A^ 
is uniformly continuous with a modulus of continuity that does not depend on £ ; 
consequently, by the uniform Lipschitz property of 7^, we see for arbitrary e > 
that the norm of the last integral is less that e/2£ as soon as £ is large enough, 
independently of j . 

Now, the first integral in (|130|) can be decomposed into a sum of at most £ 
integrals like these we just studied plus an integral over an interval of length smaller 
that l/l. Since the norm of the integrand is bounded by 2M, the norm of the last 
term is less than 2M/£. Summing over j, the above estimates tell us that, for 
t G [ii, £2] and for £ is large enough, 

This achieves the proof since £ > was arbitrary. □ 

Appendix B. Orbits of families of vector fields 

In the proof of lemma 16.21 we need results from [35] on orbit^ of families of 
smooth vector fields, that were recently exposed in the textbook [HI chapter II]. 
We recall them below, in a slightly expanded form. 

Let be a family of smooth vector fields defined on an open subset U of M d . For 
any positive integer N and vector fields X 1 , . . . , X N belonging to T, given m G U, 
consider the map F given by 

(t u ...,t N ) ~ Xl i (Xi(...(X t N N (m))---)) (132) 

where the standard notation X t (x) indicates the flow of X from x at time t; of 
course, F depends on the choice of the vector fields X^ and of the point m. This map 
is defined on some open connected neighborhood of the origin, hereafter denoted 
by dom(-F), and takes values in U. In fact, (t±, . . . , £jv) G dom(F) if, and only if, 
for every j G {1, . . . , iV}, the solution x(t) to x = X J (x), with initial condition 
x{0) = X J t Z\ (• • ■ {X^ (to)) • • • ), exists in U for all r G [0, tj] (or [t^O] if tj < 0). 



One of the motivations in |25| was to generalize the notion of integral manifolds to vector 
fields that are smooth but not real analytic. Note that the orbits of a family of real analytic vector 
fields actually coincide with the maximal integral manifolds of the closure of this family under 
Lie brackets [25] UM HE] • However, even if we assume the control system JIJ to be real analytic, 
integral manifolds are of no help to us because topological conjugacy does not preserve tangency 
nor Lie brackets. Using orbits of families of vector fields instead is much more efficient, because 
topological conjugacy does preserve integral curves. 
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The orbit of the family T through a point m 6 U is the set of all points that lie 
in the image of F for at least one choice of the vector fields X 1 , . . . , X N . In words, 
the orbit of the family T through m is the set of points that may be linked to m 
in U upon concatenating finitely many integral curves of vector fields in the family. 
We shall denote by Oyr p the orbit of T through m. 

Note that the definition depends on U in a slightly subtle manner : if T defines 
by restriction a family of vector fields T\y on a smaller open set V C U and if 
to G V, then 



but the inclusion is generally strict because of the requirement that the integral 
curves used to construct 0^\ v m should lie entirely in V . 

We turn to topological considerations. The topology of U is the usual Euclidean 
topology. The topology of CV. m as an orbit is the finest that makes all the maps F, 
arising from (|132|1 . continuous on their respective domains of definition, the latter 
being endowed with the Euclidean topology. The classical smoothness of the flow 
implies that each F is continuous dom(F) — > M d , hence the topology of Oj=. m as 
an orbit is finer than the Euclidean topology induced by the ambient space U . It 
can be strictly finer, and this is why we speak of the orbit topology, as opposed to 
the induced topology. 

Starting from T, one defines a larger family of vector fields Pjf, consisting of all 
the push-forwardqj of vector fields in T through all local diffeomorphisms of the 
form X\ o Xf 2 o • • • o Xt where X 1 , . . . , X N belong to T . That is to say, vector 
fields in Pp are of the form 



where X°, X 1 , . . . , X N belong to T. 

Remark B.I. Note that a member of Pj? is defined on an open set which is generally 
a strict subset of U, whereas members of T are defined over the whole of U , and it 
is understood that a curve 7 : I — + U, where I is a real interval, will be called an 
integral curve of Y £ Pj: only when j(I) is included in the domain of definition of 
Y. 

For x € U, we denote by Pp(x) the subspace of lR d spanned by all the vectors 
Y(x), where Y S Pp(x) is defined in a neighborhood of x. 

Theorem IB. 21 below, which is the central result in this appendix, describes the 
topological nature of the orbits. To interpret the statement correctly, it is necessary 
to recall (see for instance |24j ) that an immersed sub-manifold of a manifold is a 
subset of the latter which is a manifold in its own right, and is such that the 
inclusion map is an immersion. This allows one to naturally identify the tangent 
space to an immersed sub-manifold at a given point with a linear subspace of the 
tangent space to the ambient manifold at the same point. The topology of an 
immersed sub-manifold is in general finer than the one induced by the ambient 
manifold; when these two topologies coincide, the sub-manifold is called embedded. 

Theorem B.2 (Orbit Theorem, Sussmann [25]). Let J- be a family of smooth vector 
fields defined on an open set U C M , and m be a point in U . If Ojr m denotes the 
orbit of T through m, then: 



° Recall that the push-forward of a vector field X : V — > M d through a diffeomorphism 
if : V — » f(V) is the vector field ip+X on tp(V) whose flow at each time is the conjugate of the flow 
of X under the diffeomorphism tp; it can be defined as yj» X(^s(x)) = Dip(x)X(x), where Dtp(x) is 
the derivative of <p at x £ V. 



(133) 




(134) 
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(i) Endowed with the orbit topology, Op m has a unique differential structure 
that makes it a smooth connected immersed sub-manifold of U , for which 
the maps (|132|) are smooth. 

(ii) The tangent space to Ojr m at x £ Of m is Pjr(x). 

(iii) There exists an open neighborhood W of m in U , and smooth local coordi- 
nates £ : W — > (—77, r)) d C lR d , with £(m) = 0, such that 

(a) m £/iese coordinates, W PI Ojf m *s a product : 

Wn0^ m = (-rf xT (135) 

where rj > 0, q is the dimension of Oj=. m , and T is some subset of 
(—r),rj) d ~ q containing the origin. The orbit topology of Ojr m induces 
on W D 0;F,m the product topology where (—rj,ri) q is endowed with the 
usual Euclidean topology and T with the discrete topology. 

(b) if 7 : [ii,f2] — ► WDOf.m is an integral curve of a vector field Y S Pp 
(see remark [B~l\) . then t 1— » £i(7(i)), <Z + 1 < i < d, are constant 
mappings, 

(c) the tangent space to Of m at each point p € W n Of m is spanned by 
the vector fields d/d^i, . . . , d/dS, q , 

(d) ai any point p € W , the vector fields d/d^i, . . . , d/d^ q belong to the 
tangent space to the orbit of T through p. 

Remark B.3. Another description of the product topology in point (iii) — (a) is as 
follows. The connected components of W H Ojr m are the sets 

Sw,a = (-77,77)* x {a} (136) 

for a e T, and the topology on each of these connected components is the topology 
induced by the ambient Euclidean topology. In particular each Sw,a is an embedded 
sub-manifold of U. 

Proof of Theorem \B.2\ Assertion (i) is the standard form of the orbit theorem (cf 
e.g. [Til Chapter 2, Theorem 1]), while assertion (ii) is a rephrasing of [351 Theorem 
4.1, point (b)]. Assertion (iii) apparently cannot be referenced exactly in this form, 
but we shall deduce it from the previous ones as follows. 

By point (ii), the tangent space to 0^ jm at m € S is the linear span over 1R of 
Y 1 (m), . . . , Y q (m), where Y , . . . , Y q are q vector fields belonging to Pjr, defined on 
some neighborhood of to, and such that Y l (m), . . . , Y q (m) are linearly independent 
(recall that q is the dimension of Ojr m ). Let us write 

< = (x£o...oXifj j )^ , l<J<q, 

where X^ ,k S J 7 for < k < Nj, and where the tj^'s are real numbers for which 
the concatenated flow exists, locally around m (compare (|134[> ) . 

Since Y (to), . . . , 1^(777,) are linearly independent, one may complement them 
into a basis of lR d by adjunction of d — q independent vectors that may, without 
loss of generality, be regarded as values at m of d — q smooth vector fields in U, say 
Y q+1 , ...,Y d . Then, the smooth map 

L(fr,...,fc) = (Yi 1 o...aYZoY&\o...oY£)(m) (137) 

defines a diffeomorphism from some poly-interval = {(£1, . . . ,£d) , < 77} onto 
an open neighborhood of m in {/, simply because the derivative of L is invertible 
at the origin as Y 1 (m), . . . ,Y d (m) are linearly independent by construction. Let 
£ : W — > 2^ denote its inverse. 
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By the characteristic property of push- forwards, we locally have, for 1 < j < q, 
that 

Yl=X&a...oX>%oXgoX^o...oX* il . (138) 

This implies that, in (|137p . the images under L of those cZ-tuples sharing a common 
value of ...,£<; all lie in the same orbit Ojr.L(o,...,o,^<, + i,...,c ti )- ^ n particular, the 
map 

n,---,r g - (Y^ i o...oY^oYl + + 1 i o...oY? i )(m) 

is defined II| =1 (— rj — £7,77 — £j) — ► W fl Ojfl^i,...,^)! and this map is smooth 
from the Euclidean to the orbit topology by ()138|) and point (i). If we compose it 
with the immersive injection Jyy : W n Op,L(£i,...,£ d ) ~> W (keeping in mind that 
W C\Oj: £ d \ is open in Ojr L ^ ^ since the orbit topology is finer than the 

Euclidean one), and if we subsequently apply £, we get the affine map 

n,...,T q i-> (n ,T q + £q,Z q+ l,--- ,&). (139) 

Thus the derivative of (|139p factors through the derivative of £0 J w at -£<(£i, . . . , 
which implies (d); from this (c) follows, because q is the dimension of the orbit 
through m. If Y € is defined over an open subset of W, and if we write in the £ 
coordinates = ^ a,i(£)d/d£i, then, since is tangent to CV,£ by (m), we 
deduce from (c), that the functions dq+x, ■ ■ . , ad vanish on Of , m , whence (6) holds. 

We finally prove (a). Considering (I137j) and (I138j) . a moment's thinking will 
convince the reader that W D C^,m consists exactly, in the £ coordinates, of those 
(£1,.. .,&) such that 

te:°-°^H6^ (uo) 

which accounts for (|135[) where T is the set of (d — g)-tuples (£ 9 +i, ■■■,&) such 
that (|140p holds. To prove that the orbit topology is the product topology on 
(—r),rj) q x T where T is discrete, consider a map F as in (|132[) , and pick t — 
(ii, ...,i N ) € dom(F) such that F(t) G W (hence F(t) eWD 0^ m ) ; then F is 
continuous at t for the product topology because, for t close enough to i, the values 
£ g+ i(F(i)), . . . ,£d(F(t)) do not depend on t by (6) (moving means following the 
flow of a vector field in Pj= , namely the push- forward of X 1 through X} o • • • o j ~ ) 
while £i(F(t)), . . . , £ g (F(t)) vary continuously with i according to the continuous 
dependence on time and initial conditions of solutions to differential equations. 
Since this is true for all maps F, the orbit topology on W fl CV,m is finer than the 
product topology. To show that it cannot be strictly finer, it is enough to prove 
that the orbit topology coincides with the Euclidean topology on each set S\y,a 
defined in (|136|) . a basis of which consists of the sets O x {a} where O is open 
in (—i],r]) q . Being open for the product topology, these sets are open the orbit 
topology as well by what precedes and, since dV,m is a manifold by (i), each point 
(y, a) G O x {a} has, in the orbit topology, a neighborhood N y C O x {a} which 
is homeomorphic to an open ball of M q via some coordinate map. When viewed 
in these coordinates, the injection Af y — > O x {a} from the orbit topology to the 
Euclidean topology is a continuous injective map from an open ball in ]R q into M q , 
and therefore it is a homeomorphism onto its image by invariance of the domain. 
As (y, a) was arbitrary in O x {a}, this shows the latter is a union of open sets for 
the orbit topology, as desired. □ 

Consider now the control system : 

x = f(x,v), (141) 

with state x € M d and control u G M 7 , the function / being smooth on M d x M r . 
Let be an open subset of M d x M r and, following the notation introduced in 
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section [3 put il R d to denote its projection onto the first factor. In the proof of 
Theorem 15. 2| we shall be concerned with the following family of vector fields on 
f2 R d : 

J~' = {fifai,a 2 } a l) a 2 feedbacks on 17 } , (142) 
where feedbacks on SI were introduced in Definition 13.31 and the notation Sf au0l2 
was fixed in j25|), ([26]) . 

Since feedbacks are only required to be continuous, T' is a family of continuous 
but not necessarily differentiable vector fields on and, though the existence 
of solutions to differential equations with continuous right-hand side makes it still 
possible to define the orbit as the collection of endpoints of all concatenated inte- 
grations like (|132p , Theorem IB. 21 does not apply in this case. 

To overcome this difficulty, we will consider instead of T' the smaller family : 

T" = {lef', X has a flow } , (143) 

where the sentence U X has a flow" means, as in appendix \Kl that the Cauchy 
problem x(t) — X(x(t)), x(0) — xq, has a unique solution, defined for |i| < Eq 
where £o may depend on xq, whenever xq lies in the domain of definition of X. 
Let us consider the orbit Of,, m of T" through m 6 £l R d, which is still defined as 
the union of images of all maps (|132[) where X^ E T" , the domain of each such 
map F being again a connected open neighborhood dom(_F) of the origin in ]R N 
by repeated application of Lemma IA.1I As before, we define the orbit topology 
on Of,, i7n to be the finest that makes all the maps (|132p continuous, and since 
uniqueness of solutions implies continuous dependence on initial conditions (see 
Lemma lA.lj) , the orbit topology is again finer than the Euclidean topology. A 
priori, we know very little about Ojf".™ and its orbit topology as Theorem IB. 21 
does not apply. However, Proposition IB. 51 below will establish that these notions 
coincide with those arising from the family T of smooth vector fields obtained by 
setting : 

T = {Sf aitCt2 , ai , a? smooth feedbacks on SI }. (144) 
Note that, from the definitions (|142p . (|143p and (| 144(1 . we obviously have 

T C T" C T' , (145) 
hence the orbits of these families through a given point obey the same inclusions. 

Remark B.4. It may of course happen that the family J- 1 is empty because £1 
admits no feedback at all. However, if T' is not empty, then T is not empty either 
by Proposition 13.41 

Proposition B.5. Suppose that f : lR d x Iff — > lR d is smooth, and let SI be an 
open subset of R d x M r . Let T" be defined by ([112 )) -([Tig ]) . 

For any m S £1^, the orbit Ojr,, m of T" through m coincides with the orbit 
through m of the family T of smooth vector fields defined by (|144p . and the topology 
of Oj:n m , as an orbit of T , coincides with its topology as an orbit of T" . In 
particular, the conclusions of Theorem \B.2i hold if we replace T by T" and U by 
Sljjd . 

Remark B.6. With a limited amount of extra-work, it is possible to show that the 
orbits of T' also coincide with those of T . Hence they turn out to be manifolds 
despite the possible non-uniqueness of solutions to the Cauchy problem. However, 
(|132p is no longer convenient to define the orbit topology in this case because the 
maps F may be multiply- valued when X J G T' , and it is simpler to work with the 
family T" anyway. 



The proof of the proposition is based on the following lemma. 
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Lemma B.7. For m g tt Rd and X X ,...,X N e T" , let F : dom(F) -> fl Rd be 
defined by ()132|) . Fix i — (t\, . . . , ijy) € dom(F) and set m — F(t). 

Then, there is a neighborhood Tofiin dom(F), with F(T) C Oj^^a, such that 
F : T — > O^^m is continuous from the Euclidean topology to the orbit topology. 

Assuming the lemma for a while, we hrst prove the proposition. 

Proof of Proposition \B.5[ We noticed already from (|145p that the orbit of J-" through 
m contains the orbit of T through m. To get the reverse inclusion, consider the 
map F defined by (|132p for some vector fields X 1 , . . . , X N belonging to J 7 ". Then, 
observe from Lemma IB . 71 that F takes values in a disjoint union of orbits of T , and 
that it is continuous if each orbit in this union is endowed with the orbit topology. 
Since dom(F) is connected, F takes values in a single orbit, which can be none but 
Ojr. m . As F was arbitrary, we conclude that Ojm m c 0^^ m and therefore the two 
orbits agree as sets. Moreover, since each map F was continuous dom(F) — > CV, m, 
the orbit topology of 0jr".m is by definition finer than the orbit topology of Ojr m ; 
but since it is also coarser, by definition of the orbit topology on Ojr m , because 
T C T" , the two topologies in turn agree as desired. □ 

Proof of Lemma \B. 7[ Theorem IB. 21 applied to the family T , at the point m = 
F(t), yields an open neighborhood W of m in f2 K d and smooth local coordinates 
(£i, . .. : W — > {—rj,r]) d satisfying properties (Hi) — (a) to (Hi) — (d) of that 
theorem. For e > denote by T e the compact poly-interval : 

% = {t=(h,...,t N )elR N , \U-U\ <e}. 

By Lemma IA.11 F is continuous dom(_F) — > fl^d and, since dom(_F) is an open 
neighborhood of t in M N , we can pick e > such that 

% c dom(-F) and F(%) c W . 

As X 1 , . . . , X N belong to T" C T' , we can write 

X 1 = Sf <ai , 1 < t < N 

for some collection of feedbacks a{, a 2 on f2. From Proposition 13.41 there exists 
for each (£,l) £ {1,...,7V} x {1,2} a sequence of smooth feedbacks on ft, say 
(Pf' k )k£]N, converging to a\ uniformly on ft^d. Subsequently, we let Y e ' k denote, 
for 1 < £ < N and k 6 IN, the smooth vector field on 

Y e ' k = Sf p i,h tP i,k . 

Clearly Y l:k £ T and, for each I, we have that Y l,k converges to X 1 as k — > oo, 
uniformly on compact subsets of ft R d. 

Now, pick j £ {1, . . . , TV} and consider a A^-tuple e 7^ of the form : 

=(?!,..., tj, . . . , tjv) , |*/ - t/| < £ for j < I < N. 

Let also lj designate, for simplicity, the TV-tuple (0, . . . , 1, . . . , 0) with zero entries 
except for the j-th one which is 1. Then, for |A| < e, we have that 

t^' + Xlj = (ti, . . . , tj-i,ij + X, tj + i, . . . , i/v) G ^ej 

and a simple computation allows us to rewrite F(t + Xlj) as : 

F(t& + Xlj) = Xl o • • • o Xfc o X{ o A^ o • • • o Xi fl (F(t)). 

Let us set 

A fc (A) = Y^ k o • • • o yi- 1 -* o y* fe o y^u o • • • c y^(F(i)). 

Repeated applications of Lemmas IA.1I and I A. 2 1 show that, for fixed j and t^\ the 
map A i— > Ak(X) is well-defined [—£,£] ~^ W as soon as the integer k is sufficiently 
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large, and moreover that Ak(X) converges to F(t^' + Xlj) as k — > +00, uniformly 
with respect to A G [— e, e\. Now, by the characteristic property push forwards, 
A 1— > Ak (A) is an integral curve of the smooth vector field 

Z k = ^yt,k Q . . . Q yj l.*A yj.k ^ 

which is defined on a neig hborhoodof{F(iW+Al.,); |A| < e} in W. Since Z " e 
(cf equation (|134p ). it follows from point (Hi) — (b) of Theorem IB . 2 1 that . for k large 
enough, 

£ioA k (\) = 6°4(0), VA € [-e,e], ie {g + l,...,d}. 

It is clear from the definition that Ak(0) = F(t^); hence, using the continuity of 
£i and taking, in the above equation, the limit as k — > +00, we get 

t i oF(stW + Xl j )={ i oF{tV>), VAe [-e,£], ie{« + l,...,d}. (146) 

Since o F(f) = • • • = £ d o F(t) — by definition of W, successive applications 
of p46p for j = N, . . . , 1 lead us to the conclusion that 

o F(t) = • • • = £ d o F(t) - 0, Vt e T £ . (147) 

Equation (I147|) means that, in the ^-coordinates, F(%) C (~ri,ri) q x {0}. Hence, 
from the local description of the orbits in (|135[) (where m is to be replaced by to), 
we deduce that F(%) c C^,m- Actually, with the notations of (|136p . we even get 
the stronger conclusion that 

F(T E ) c Sw,o 

which achieves the proof of the lemma, with T = T £ , because the orbit topology on 
Sw,o is the Euclidean topology by Remark IB. 31 □ 
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